-- Logs begin at Tue 2022-06-14 23:29:46 UTC, end at Wed 2022-06-15 01:07:29 UTC. -- Jun 15 00:31:42.218901 dv-cinder-845178-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 00:31:42.227971 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 00:31:42 2022] *** Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: nodename: dv-cinder-845178-5-iscsi Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: machine: x86_64 Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: clock source: unix Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: pcre jit disabled Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: detected number of CPU cores: 4 Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: current working directory: / Jun 15 00:31:42.229909 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: detected binary path: /usr/bin/uwsgi-core Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: your processes number limit is 47680 Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: your memory page size is 4096 bytes Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: detected max file descriptor number: 2048 Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: lock engine: pthread robust mutexes Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: thunder lock: enabled Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 00:31:42.230690 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 00:31:42.273855 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: Python main interpreter initialized at 0x560db0cfc9c0 Jun 15 00:31:42.273855 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: python threads support enabled Jun 15 00:31:42.273855 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: your server socket listen backlog is limited to 100 connections Jun 15 00:31:42.273855 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: your mercy for graceful operations on workers is 90 seconds Jun 15 00:31:42.274193 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 00:31:42.274278 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: *** Operational MODE: preforking *** Jun 15 00:31:42.274511 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: *** uWSGI is running in multiple interpreter mode *** Jun 15 00:31:42.274511 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: spawned uWSGI master process (pid: 110309) Jun 15 00:31:42.274691 dv-cinder-845178-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 00:31:42.275248 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: spawned uWSGI worker 1 (pid: 110310, cores: 1) Jun 15 00:31:42.275594 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: spawned uWSGI worker 2 (pid: 110311, cores: 1) Jun 15 00:31:42.275765 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 00:31:42.927477 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 00:31:42.928089 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 00:31:44.092443 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:31:44.092443 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: from cryptography.utils import int_from_bytes Jun 15 00:31:44.093165 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:31:44.093165 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: from cryptography.utils import int_from_bytes Jun 15 00:31:44.093165 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:31:44.093165 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: from cryptography.utils import int_from_bytes Jun 15 00:31:44.093688 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:31:44.093688 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: from cryptography.utils import int_from_bytes Jun 15 00:31:46.658990 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:31:46.659761 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:31:46.659761 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:31:46.660161 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:31:46.660418 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:31:46.660807 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.661130 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.661449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.661680 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:31:46.662089 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.662224 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:31:46.662354 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.662354 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.662597 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:31:46.662728 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.662860 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:31:46.662987 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.663120 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:31:46.663303 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.663446 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.663573 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.663703 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.663863 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664041 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664210 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-5-iscsi {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664348 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664530 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664661 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664833 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.664956 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665142 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665288 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665461 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665599 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665764 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.665890 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666026 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666161 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666477 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666647 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-5-iscsi {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.666846 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.667379 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.667379 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.667727 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.667898 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.668117 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.668304 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.668469 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.668665 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.668854 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669037 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669255 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669447 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669603 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669603 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.669938 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670128 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670310 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670481 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670641 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670809 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670977 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.670977 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.671314 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-5-iscsi {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.671492 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.671654 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.671827 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.672029 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.672364 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.672542 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.672719 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.672890 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673058 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673240 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673412 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673561 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673741 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-5-iscsi {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.673900 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.674077 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.674242 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.674901 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675049 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675193 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675343 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675492 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675653 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675810 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.675978 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.676136 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.676293 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.676533 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.676687 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.676841 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677005 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677151 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677295 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677445 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677601 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677756 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.677912 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678062 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678219 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678373 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678532 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678676 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678820 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.678973 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679130 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679319 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679480 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679642 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679799 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.679994 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680156 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680156 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680445 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680445 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680739 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.680892 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681036 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681193 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681348 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681502 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681653 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681797 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.681967 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.682120 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.682323 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.682546 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.682701 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.682912 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683142 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683299 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683447 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683602 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683753 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.683896 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684094 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684246 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684400 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684704 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.684857 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685008 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685159 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685303 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685456 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685456 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685739 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.685739 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686031 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686190 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686345 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686496 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686730 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.686876 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687028 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687182 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687325 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687468 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687627 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687779 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.687991 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688156 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688309 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688476 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688622 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688772 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.688923 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689074 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689225 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689426 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689587 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689746 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.689897 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.690105 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.690788 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.690945 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691097 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691241 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691391 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691541 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691691 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.691844 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692049 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692203 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692350 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692554 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692744 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.692897 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693044 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693193 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693351 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693501 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693658 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693806 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.693961 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694118 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694266 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694414 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694576 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694737 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.694887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695036 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695190 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695337 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695497 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695653 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695801 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.695993 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696143 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696296 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696455 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696600 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696764 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.696977 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697125 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697280 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697427 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697581 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697737 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.697893 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698046 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698199 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698353 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698504 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698662 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698809 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.698955 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699110 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699257 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699416 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699603 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699753 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.699964 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700114 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700271 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700416 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700560 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700716 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.700860 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701016 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701173 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701317 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701468 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701611 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701754 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.701905 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702049 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702199 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702345 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702501 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702683 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.702869 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703015 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703166 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703315 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703466 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703610 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703763 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.703932 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704089 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704238 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704397 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704555 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704711 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.704860 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705007 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705155 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705304 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705462 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705611 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705758 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.705907 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706055 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706204 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706361 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706361 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706652 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.706807 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.706979 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.707195 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.707357 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.707508 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.707656 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.707804 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.707986 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.708151 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:31:46.708307 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.708453 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.708605 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.708758 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.708914 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709068 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709221 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709372 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709536 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709711 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.709866 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710026 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710185 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710341 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710502 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710651 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.710872 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711021 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711180 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711328 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711473 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711625 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.711787 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712002 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712171 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712329 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712482 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712652 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.712858 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713025 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713170 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713328 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713481 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713633 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713792 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.713950 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714095 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714239 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714392 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714537 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714695 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714842 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.714994 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715137 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715280 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715423 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715576 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715720 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.715873 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716048 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716195 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716356 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716508 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716661 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716812 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.716960 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717104 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717340 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717488 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717641 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717787 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.717933 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718086 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718241 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718396 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718547 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718694 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718839 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.718986 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719140 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719294 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719447 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719600 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719763 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.719957 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720124 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720302 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720470 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720629 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720777 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.720931 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721078 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721224 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721369 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721515 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721659 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721817 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.721963 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722109 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722255 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722400 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722551 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722705 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.722870 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723049 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723211 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723366 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723516 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723675 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.723825 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724028 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724176 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724322 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724476 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724476 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724765 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.724909 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725060 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725204 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725364 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725509 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725652 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725796 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725940 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.725940 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726229 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726229 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726510 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726661 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726806 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.726950 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727105 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727258 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727493 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727652 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727797 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.727993 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728165 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728317 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728482 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728637 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728781 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.728924 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729065 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729216 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729355 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729496 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729635 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729808 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.729969 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730127 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730303 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730458 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730608 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730766 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.730912 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731058 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731208 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731353 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731508 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731671 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.731834 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.732547 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.733105 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.733289 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.733484 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.733669 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.733844 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.734017 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.734192 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.734368 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.734665 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.734846 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735033 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735209 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735399 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735571 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735759 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.735931 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.736072 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.736204 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.744908 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745520 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745609 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745691 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745770 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745882 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.745965 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746034 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746106 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746173 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746238 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746302 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746375 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746443 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746517 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746583 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746649 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746714 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746786 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746860 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746932 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.746999 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747064 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747128 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747200 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747267 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747333 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747405 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747479 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747554 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747621 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747686 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747750 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747814 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.747888 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748006 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748077 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748162 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748249 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748336 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748415 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748502 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748666 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748745 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748821 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.748926 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749034 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749115 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749193 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749271 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749355 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749431 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749500 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749565 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749629 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749694 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749758 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749835 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.749977 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750042 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750108 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750179 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750256 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750323 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750388 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750452 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750517 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750582 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750654 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750721 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750793 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750859 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.750930 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751028 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751098 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751163 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751227 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751291 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751356 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751428 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751501 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751578 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751644 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751708 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751779 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751857 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.751940 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752032 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752109 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752176 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752254 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752254 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752392 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752457 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752556 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.752632 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753196 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753274 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753342 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753407 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753479 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753545 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753618 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753685 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753749 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753814 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753884 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.753951 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754023 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754090 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754154 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754219 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754283 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754356 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754431 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754498 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754570 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754644 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754717 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754783 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754859 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754927 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.754998 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755083 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755157 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755231 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755298 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755363 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755427 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755491 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755554 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755626 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755692 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755757 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755757 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.755969 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756052 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756120 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756184 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756255 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756321 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756385 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756469 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756537 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756608 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756686 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756764 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756764 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756900 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.756965 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757030 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757094 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757158 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757229 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757296 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757296 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757410 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757487 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757559 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757637 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757704 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757704 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757824 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757890 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757954 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.757954 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758085 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758160 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758226 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758290 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758429 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758505 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758571 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758635 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758706 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758773 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758846 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758912 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.758976 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759052 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759117 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759181 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759253 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759417 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759509 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759707 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.759828 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.760038 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.760141 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.760347 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.760457 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.760910 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761002 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761229 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761317 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761537 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761624 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761841 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.761925 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762146 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762232 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762447 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762532 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762751 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.762848 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763065 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763152 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763369 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763640 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763726 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.763984 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764090 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764285 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764372 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764586 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764673 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764905 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.764990 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.765221 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.765497 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.765592 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.765826 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.765921 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766137 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766230 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766450 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766546 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766763 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.766850 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767063 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767156 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767365 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767451 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767672 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767759 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.767997 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768089 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768352 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768449 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768657 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768744 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.768964 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769058 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769267 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769354 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769568 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769654 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769868 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.769962 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770168 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770255 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770463 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770555 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770767 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.770862 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771065 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771151 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771363 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771662 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771760 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.771986 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772087 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772289 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772382 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772585 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772883 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.772967 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773177 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773263 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773494 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773583 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773797 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.773883 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774093 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774179 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774388 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774475 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774683 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.774769 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775017 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775113 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775317 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775403 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775644 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775729 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.775965 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776065 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776267 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776353 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776576 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776663 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776880 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.776975 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777177 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777271 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777482 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777568 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777776 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.777870 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778072 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778164 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778373 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778457 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778758 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.778962 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779047 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779260 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779344 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779555 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779649 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.779856 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780004 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780179 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780264 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780472 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780558 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780773 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.780859 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781069 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781156 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781365 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781460 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781662 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781747 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.781958 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782054 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782249 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782334 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782636 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782844 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.782974 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.783136 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.783239 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.783436 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.783531 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784250 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784358 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784570 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784663 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784867 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.784960 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785164 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785259 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785460 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785555 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785759 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.785845 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786059 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786146 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786359 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786444 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786658 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786752 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.786964 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787051 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787282 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787369 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787595 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787689 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.787896 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788001 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788222 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788311 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788518 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788604 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788816 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.788901 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789116 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789203 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789422 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789517 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789717 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.789810 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790014 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790099 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790309 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790406 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790607 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790692 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790903 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.790994 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791204 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791298 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791499 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791594 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791794 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.791880 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792113 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792212 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792411 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792498 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792706 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.792792 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793021 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793103 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793324 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793410 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793620 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793710 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.793918 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794005 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794213 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794300 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794547 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794634 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794844 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.794931 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795152 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795237 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795452 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795547 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795763 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.795850 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796092 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796191 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796397 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796482 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796696 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796781 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.796997 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797090 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797293 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797387 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797603 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797697 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797906 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.797992 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798210 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798304 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798508 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798602 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798805 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.798891 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.799119 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.799213 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.799472 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800099 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800313 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800408 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800634 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800729 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.800953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801039 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801270 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801356 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801569 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801656 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801873 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.801966 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802175 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802262 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802478 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802579 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802783 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.802870 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803083 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803175 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803387 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803473 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803690 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.803776 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804017 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804108 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804322 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804409 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804625 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804711 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.804925 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805023 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805230 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805317 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805532 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805617 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805829 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.805921 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806130 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806221 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806440 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806558 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806738 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.806869 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807042 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807179 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807339 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807484 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807643 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807795 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.807962 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.808138 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.808392 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.808480 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.808701 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.808789 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809009 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809102 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809444 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809617 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809757 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.809920 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810228 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810377 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810538 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810681 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.810983 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.811242 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.811329 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.811550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.811638 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.811857 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812001 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812186 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812285 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812485 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812571 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812785 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.812878 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813088 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813187 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813407 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813493 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813706 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.813821 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814005 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814135 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814305 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814444 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814619 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814855 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.814942 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815197 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815292 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815508 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815641 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815826 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.815969 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816188 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816275 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816514 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816666 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816819 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.816974 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817132 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817279 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817441 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817595 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817764 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.817911 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818085 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818227 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818393 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818527 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818706 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.818831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819009 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819136 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819330 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819452 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819651 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819770 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.819985 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.820088 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.820306 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.820400 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.820687 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.820773 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821003 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821093 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821321 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821415 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821629 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821716 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.821945 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822040 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822248 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822354 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822551 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822673 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822864 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.822976 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823167 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823292 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823469 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823610 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823792 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.823922 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824130 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824220 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824441 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824541 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824747 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.824834 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825054 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825142 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825358 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825453 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825660 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825754 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.825973 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826060 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826274 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826370 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826576 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826663 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826873 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.826960 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827169 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827263 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827481 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827574 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827779 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.827872 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828118 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828207 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828424 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828510 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828726 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.828816 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829027 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829123 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829324 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829410 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829638 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829724 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.829941 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830029 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830238 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830324 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830534 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830628 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830861 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.830949 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831198 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831285 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831499 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831593 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831812 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.831898 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832158 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832247 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832474 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832573 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832778 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.832863 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833084 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833169 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833384 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833695 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833784 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.833999 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834085 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834307 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834403 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834602 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834689 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834899 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.834985 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835197 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835283 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835494 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835579 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835792 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.835878 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836112 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836201 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836416 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836503 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836712 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.836799 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837007 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837094 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837301 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837395 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837600 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837687 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837901 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.837997 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838210 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838296 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838513 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838608 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838809 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.838905 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839105 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839192 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839398 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839493 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839730 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.839819 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840054 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840145 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840378 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840478 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840693 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.840778 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841007 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841093 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841320 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841420 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841622 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841715 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.841933 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842017 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842241 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842334 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842548 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842634 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842855 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.842940 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843161 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843246 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843471 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843564 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843779 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.843866 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844111 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844326 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844413 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844657 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844751 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.844974 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845070 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845287 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845374 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845600 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845805 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.845905 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.846130 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.846216 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.846961 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847048 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847272 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847367 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847580 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847675 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847890 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.847989 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848214 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848316 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848521 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848608 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848827 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.848920 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849131 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849219 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849436 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849524 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849759 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.849852 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850074 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850164 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850388 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850474 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850717 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.850805 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851025 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851113 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851334 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851419 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851642 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851740 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.851972 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852062 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852285 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852370 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852595 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852684 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852903 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.852989 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853208 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853301 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853516 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853602 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853821 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.853906 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854125 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854210 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854426 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854512 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854731 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.854817 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855034 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855120 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855337 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855431 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855638 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855732 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.855965 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856068 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856274 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856369 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856590 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856675 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.856914 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857103 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857226 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857416 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857529 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857746 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.857840 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858069 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858156 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858392 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858618 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858705 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.858926 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859014 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859252 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859338 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859569 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859656 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.859988 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860217 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860525 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860613 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860827 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.860914 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861133 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861218 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861431 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861524 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861732 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.861825 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.862579 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.862671 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.862882 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.862979 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.863197 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.863407 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.863493 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.863753 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.863840 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864090 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864180 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864399 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864486 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864733 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.864925 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865048 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865269 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865357 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865582 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865676 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865904 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.865992 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866227 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866313 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866538 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866626 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866844 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.866932 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867143 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867237 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867448 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867544 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867747 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.867837 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868080 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868168 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868384 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868470 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868681 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868768 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.868983 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869069 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869291 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869387 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869598 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869690 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869896 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.869983 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870195 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870288 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870492 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870577 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870792 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.870877 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871096 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871195 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871395 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871480 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871693 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.871777 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872023 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872131 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872323 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872410 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872622 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872708 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.872920 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873016 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873218 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873306 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873517 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873602 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873812 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.873898 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874114 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874204 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874412 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874506 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874716 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.874803 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875013 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875107 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875315 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875402 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875638 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875724 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.875985 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876073 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876287 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876585 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876673 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876894 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.876987 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.877197 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.877292 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.877536 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.877766 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.877854 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878101 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878188 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878423 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878511 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878757 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.878843 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879087 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879275 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879439 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879602 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879689 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.879953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880045 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880264 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880360 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880589 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880676 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880891 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.880977 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881195 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881283 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881495 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881582 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881802 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.881887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882107 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882193 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882412 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882497 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882716 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.882808 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883026 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883152 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883327 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883429 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883632 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883728 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.883957 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884057 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884266 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884363 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884570 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884666 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884872 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.884960 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.885176 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.885269 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.885477 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.885836 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886043 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886129 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886378 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886498 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886689 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886842 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.886997 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887160 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887304 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887554 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887649 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887872 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.887972 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888207 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888294 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888613 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888822 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.888908 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889127 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889261 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889435 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889523 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.889831 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890068 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890163 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890377 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890465 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890675 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.890761 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891026 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891120 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891334 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891421 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891652 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891738 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.891984 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892089 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892301 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892386 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892617 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892704 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.892933 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893034 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893267 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893369 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893580 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893665 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893882 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.893975 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894183 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894322 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894491 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894585 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894814 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.894903 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895125 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895212 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895428 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895567 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895728 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.895815 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896051 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896141 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896352 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896439 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896652 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896740 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.896953 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897048 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897250 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897336 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897548 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897636 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897845 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.897930 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898140 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898235 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898437 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898522 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898732 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.898817 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899029 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899129 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899326 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899418 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899620 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899705 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.899941 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900044 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900231 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900317 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900527 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900612 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900824 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.900919 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901121 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901213 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901422 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901507 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901722 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.901810 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902019 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902112 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902314 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902400 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902612 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902699 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.902908 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903003 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903318 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903557 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903644 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903865 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.903980 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904236 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904361 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904548 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904636 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904863 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.904950 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905168 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905263 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905477 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905564 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905789 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.905883 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906097 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906194 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906398 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906484 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906704 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.906798 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907011 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907108 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907316 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907402 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907620 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907708 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.907960 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.908126 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.908256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.908344 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.908560 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.908648 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.909431 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.909536 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.909697 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.909785 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.909997 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910082 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910316 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910403 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910622 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910715 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.910933 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911020 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911239 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911325 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911545 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911637 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.911861 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912014 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912193 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912293 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912497 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912627 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912808 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.912905 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913115 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913210 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913421 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913509 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913730 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.913827 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914042 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914130 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914363 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914487 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914685 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914772 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.914992 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915079 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915312 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915398 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915621 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.915943 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.916069 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.916191 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:31:46.916279 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.916603 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.916926 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.917238 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.917544 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.917844 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:31:46.918084 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:31:46.977442 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Registered counter for database nova_api Jun 15 00:31:46.978723 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO dbcounter [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Registered counter for database nova_api Jun 15 00:31:46.998562 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.001004 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_db.sqlalchemy.engines [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.005174 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.007385 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writer thread running {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.061912 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.context [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6dffbe-391d-463b-94f8-73114df29399(cell1) {{(pid=110310) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 00:31:47.064125 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.context [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6dffbe-391d-463b-94f8-73114df29399(cell1) {{(pid=110311) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 00:31:47.066065 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:31:47.067628 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:31:47.068215 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_concurrency.lockutils [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:31:47.068457 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:31:47.069783 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_concurrency.lockutils [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:31:47.070421 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:31:47.070576 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_concurrency.lockutils [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:31:47.072386 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Registered counter for database nova_cell0 Jun 15 00:31:47.072550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_concurrency.lockutils [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:31:47.074467 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO dbcounter [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Registered counter for database nova_cell0 Jun 15 00:31:47.076188 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Registered counter for database nova_cell1 Jun 15 00:31:47.078236 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO dbcounter [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Registered counter for database nova_cell1 Jun 15 00:31:47.083610 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.085397 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.086611 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_db.sqlalchemy.engines [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.088951 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_db.sqlalchemy.engines [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.090941 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.093492 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writer thread running {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.093601 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.232361 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writer thread running {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.238760 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO dbcounter [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Registered counter for database nova_cell0 Jun 15 00:31:47.242102 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO dbcounter [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Registered counter for database nova_cell0 Jun 15 00:31:47.247462 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_db.sqlalchemy.engines [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.250940 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG oslo_db.sqlalchemy.engines [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:31:47.252240 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writer thread running {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.255185 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writer thread running {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:31:47.681344 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:31:47.688599 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:31:47.709045 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: WARNING keystonemiddleware.auth_token [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:31:47.716218 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: WARNING keystonemiddleware.auth_token [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:31:48.026492 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:31:48.032454 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: WARNING keystonemiddleware.auth_token [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:31:48.037600 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560db0cfc9c0 pid: 110310 (default app) Jun 15 00:31:48.039637 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:31:48.040834 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jun 15 00:31:48.041242 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Jun 15 00:31:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:31:48.060510 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: WARNING keystonemiddleware.auth_token [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:31:48.067249 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: WARNING keystonemiddleware.auth_token [None req-84eeb322-ce91-4ad7-b392-58e85023d6d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:31:48.072667 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560db0cfc9c0 pid: 110311 (default app) Jun 15 00:33:06.366990 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:06.368740 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002170 Jun 15 00:33:06.369873 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:06.381213 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_api:SELECT=3 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:06.382055 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_cell1:SELECT=3 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:06.382946 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_cell0:SELECT=3 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:06.384115 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:06.809682 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-531431d1-01c5-4bbd-ba7d-5645dc6f57be admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:06.838484 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-531431d1-01c5-4bbd-ba7d-5645dc6f57be admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462326 Jun 15 00:33:06.839444 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jun 15 00:33:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:08.988081 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:08.988999 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-a225467e-ddc0-4a9e-9e41-cecadd02910c None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 15 00:33:08.989653 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:09.051530 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-6cbf72bc-3c40-4a4f-89d7-d67b52c8703d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:09.069632 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:33:09.069632 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: warnings.warn(msg) Jun 15 00:33:09.167885 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-6cbf72bc-3c40-4a4f-89d7-d67b52c8703d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171447 Jun 15 00:33:09.175700 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:09.182312 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:09.183560 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell1:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:09.184525 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell0:SELECT=3 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:09.185550 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:09.390651 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-ab133deb-a50b-4e20-8f04-734ac5dcd589 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:09.393112 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:33:09.393112 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:33:09.516788 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-ab133deb-a50b-4e20-8f04-734ac5dcd589 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339982 Jun 15 00:33:09.517642 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jun 15 00:33:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:11.680692 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-6cbf72bc-3c40-4a4f-89d7-d67b52c8703d admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:11.681792 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-6cbf72bc-3c40-4a4f-89d7-d67b52c8703d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jun 15 00:33:11.682259 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:11.815037 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-8ffe4dae-8129-4d13-9c80-39ddc0055d70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "ram": 512}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:11.833208 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:33:11.833208 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:33:11.923415 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-8ffe4dae-8129-4d13-9c80-39ddc0055d70 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.235215 Jun 15 00:33:11.924093 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:11.936082 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-61716620-ab98-4c8d-b74e-82fdf227d465 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:11.937644 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:33:11.937644 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: warnings.warn(msg) Jun 15 00:33:12.020323 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-61716620-ab98-4c8d-b74e-82fdf227d465 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087789 Jun 15 00:33:12.020834 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jun 15 00:33:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:14.200962 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-8ffe4dae-8129-4d13-9c80-39ddc0055d70 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:14.202000 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-8ffe4dae-8129-4d13-9c80-39ddc0055d70 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 15 00:33:14.202596 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:33:14.262042 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-e7f78f67-9687-4bcd-800e-68b766c44399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "vcpus": 1}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:14.347770 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-e7f78f67-9687-4bcd-800e-68b766c44399 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139137 Jun 15 00:33:14.348678 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 00:33:14.360814 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-183c9639-2e3c-44f8-84e5-e1a4939c9be9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:14.450780 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-183c9639-2e3c-44f8-84e5-e1a4939c9be9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093602 Jun 15 00:33:14.452820 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jun 15 00:33:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:16.608331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-e7f78f67-9687-4bcd-800e-68b766c44399 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:16.609429 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-e7f78f67-9687-4bcd-800e-68b766c44399 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jun 15 00:33:16.609823 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:16.672081 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-c984749f-b0ad-4bab-99ca-a1b0ccf083c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:16.736304 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-c984749f-b0ad-4bab-99ca-a1b0ccf083c8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119871 Jun 15 00:33:16.737186 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:16.749871 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4e43a964-cd0a-414e-b44d-f9828a95add5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:16.831339 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4e43a964-cd0a-414e-b44d-f9828a95add5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085635 Jun 15 00:33:16.832224 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jun 15 00:33:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:18.994966 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-c984749f-b0ad-4bab-99ca-a1b0ccf083c8 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:18.995899 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-c984749f-b0ad-4bab-99ca-a1b0ccf083c8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 15 00:33:18.996398 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:19.055788 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:19.125721 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.123065 Jun 15 00:33:19.126412 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:19.138504 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f4639c50-0ff8-4eeb-9754-3b3e610cddd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:19.209341 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f4639c50-0ff8-4eeb-9754-3b3e610cddd0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074634 Jun 15 00:33:19.210022 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Jun 15 00:33:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:21.364154 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:21.365170 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 15 00:33:21.365568 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:21.431581 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-71015cfd-0409-4ee5-9512-d801773d5780 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:21.456179 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-71015cfd-0409-4ee5-9512-d801773d5780 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084503 Jun 15 00:33:21.458387 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jun 15 00:33:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:33:23.647054 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:23.648112 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-274f3a46-4763-434b-9101-12ca266845de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 15 00:33:23.648597 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:23.707149 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-2a457897-42df-4c9e-92a7-4a73b97c3c06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:23.828384 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-2a457897-42df-4c9e-92a7-4a73b97c3c06 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.173825 Jun 15 00:33:23.828857 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 00:33:23.840734 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-2303f0a1-e274-4cfa-a12e-1309827bc188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:23.922902 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-2303f0a1-e274-4cfa-a12e-1309827bc188 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085753 Jun 15 00:33:23.923512 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jun 15 00:33:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:26.097069 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-2a457897-42df-4c9e-92a7-4a73b97c3c06 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:26.098141 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-2a457897-42df-4c9e-92a7-4a73b97c3c06 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 15 00:33:26.098544 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:26.158955 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-c75ac1cb-2854-4257-822e-b92c1529bdb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:26.231580 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-c75ac1cb-2854-4257-822e-b92c1529bdb2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.125931 Jun 15 00:33:26.232173 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:26.247530 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-27539979-e27c-4152-8edc-a42f1f675d1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:26.326838 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-27539979-e27c-4152-8edc-a42f1f675d1a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084218 Jun 15 00:33:26.327445 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jun 15 00:33:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:28.940992 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-c75ac1cb-2854-4257-822e-b92c1529bdb2 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:28.942161 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-c75ac1cb-2854-4257-822e-b92c1529bdb2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jun 15 00:33:28.942555 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:29.001329 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-1db80b17-4b69-45bb-8095-62d0de3ba232 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:29.142731 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-1db80b17-4b69-45bb-8095-62d0de3ba232 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.194056 Jun 15 00:33:29.143272 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:29.154929 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-72a6cc39-f2fa-462c-8b0a-7cc8b203635b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:29.218482 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-72a6cc39-f2fa-462c-8b0a-7cc8b203635b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067217 Jun 15 00:33:29.219028 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jun 15 00:33:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:31.363346 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-1db80b17-4b69-45bb-8095-62d0de3ba232 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:31.364519 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-1db80b17-4b69-45bb-8095-62d0de3ba232 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jun 15 00:33:31.364909 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:31.424149 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-ba447cf5-deca-4eac-892d-1768ee2f1efd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "4"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:31.512875 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-ba447cf5-deca-4eac-892d-1768ee2f1efd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142087 Jun 15 00:33:31.513940 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:33:31.526336 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-f2a8be1c-84ad-4b38-bb88-0a00e4541320 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:31.590632 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-f2a8be1c-84ad-4b38-bb88-0a00e4541320 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068163 Jun 15 00:33:31.592324 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jun 15 00:33:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:33:33.800265 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-ba447cf5-deca-4eac-892d-1768ee2f1efd admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:33.801260 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-ba447cf5-deca-4eac-892d-1768ee2f1efd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jun 15 00:33:33.801654 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:33.864592 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:33.953256 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.145044 Jun 15 00:33:33.953723 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Jun 15 00:33:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 00:33:33.978232 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-642991e7-2519-418d-98e9-c12c4063bac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:33:34.775416 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-642991e7-2519-418d-98e9-c12c4063bac5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.812560 Jun 15 00:33:34.776080 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Jun 15 00:33:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:33:58.190268 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:58.191275 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 15 00:33:58.191663 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:58.204734 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:58.253318 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-ef1006c8-484a-4639-9bcb-3409118e934c admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:58.270870 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-ef1006c8-484a-4639-9bcb-3409118e934c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073122 Jun 15 00:33:58.271398 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jun 15 00:33:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:33:59.222798 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:59.223794 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-eccb5260-c806-4bf3-84f6-bed89910cc0a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 15 00:33:59.224224 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:33:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:33:59.412161 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-70ade68e-2b05-459c-a74d-a1c9d4ba91e8 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:59.417571 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.wsgi [None req-70ade68e-2b05-459c-a74d-a1c9d4ba91e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-70ade68e-2b05-459c-a74d-a1c9d4ba91e8 admin admin] Request method failure captured: Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept: application/json Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept-Encoding: gzip, deflate Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Connection: keep-alive Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Content-Length: 0 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Host: 10.222.0.17 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-Api-Version: compute 2.90 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-System-Scope: None Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: User-Agent: python-novaclient Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Auth-Token: gAAAAABiqSj3TK2XwKNWp2C8zgf99upmj6vEpWCPWl01V7kJCcn8rtuBmcfgTpp87HeTItVbzBt1zN9WpUIJgoI0_pYhFVCShGI6GzcD3RXA0MuzmfF3-95fxy_A5H73DQLqyyzIIE7Ad5Ph_81vH9doUEzMT0L3mM9p9NRY4L6PNousk9TahTY Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Id: None Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Name: None Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Identity-Status: Confirmed Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Is-Admin-Project: True Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Id: default Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Name: Default Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Name: admin Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Role: member,admin,reader Jun 15 00:33:59.421311 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Roles: member,admin,reader Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant: admin Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Name: admin Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User: admin Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Id: default Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Name: Default Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Name: admin Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: method: > Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: exception: Flavor 42 could not be found. Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: action_args: {'id': '42'} Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:33:59.422881 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:33:59.423831 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.424953 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-70ade68e-2b05-459c-a74d-a1c9d4ba91e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:33:59.425974 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-70ade68e-2b05-459c-a74d-a1c9d4ba91e8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061697 Jun 15 00:33:59.425974 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jun 15 00:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 00:33:59.432285 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-2b5c37e2-6e64-411b-92e3-2e9b47d55f3b admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:59.435864 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:59.454021 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-2b5c37e2-6e64-411b-92e3-2e9b47d55f3b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025290 Jun 15 00:33:59.454562 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:33:59.464178 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-615fe5b3-d216-49b1-b392-33da29c47f3e admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:59.485542 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-615fe5b3-d216-49b1-b392-33da29c47f3e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024866 Jun 15 00:33:59.486062 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:33:59.494948 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3d2c643d-0194-4b3c-846e-0c7e5c162096 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:33:59.501804 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-3d2c643d-0194-4b3c-846e-0c7e5c162096 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3d2c643d-0194-4b3c-846e-0c7e5c162096 admin admin] Request method failure captured: Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept: application/json Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Connection: keep-alive Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Content-Length: 0 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Host: 10.222.0.17 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABiqSj3TK2XwKNWp2C8zgf99upmj6vEpWCPWl01V7kJCcn8rtuBmcfgTpp87HeTItVbzBt1zN9WpUIJgoI0_pYhFVCShGI6GzcD3RXA0MuzmfF3-95fxy_A5H73DQLqyyzIIE7Ad5Ph_81vH9doUEzMT0L3mM9p9NRY4L6PNousk9TahTY Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Role: member,admin,reader Jun 15 00:33:59.505035 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Roles: member,admin,reader Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant: admin Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User: admin Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Name: admin Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: method: > Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: exception: Flavor 42 could not be found. Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: action_args: {'id': '42'} Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:33:59.510670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:33:59.511714 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:33:59.512856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3d2c643d-0194-4b3c-846e-0c7e5c162096 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:33:59.513868 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-3d2c643d-0194-4b3c-846e-0c7e5c162096 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014928 Jun 15 00:33:59.513868 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jun 15 00:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:00.370509 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-615fe5b3-d216-49b1-b392-33da29c47f3e admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:00.372042 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-615fe5b3-d216-49b1-b392-33da29c47f3e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 15 00:34:00.372432 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:00.564088 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-d797bbfb-be1d-4c0f-a8a3-5f8152cdf288 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:00.569398 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-d797bbfb-be1d-4c0f-a8a3-5f8152cdf288 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-d797bbfb-be1d-4c0f-a8a3-5f8152cdf288 admin admin] Request method failure captured: Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept: application/json Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Connection: keep-alive Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Content-Length: 0 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Host: 10.222.0.17 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABiqSj4_tNA8fl8gcyCn0ZEnFwRS7gSXUGF-7M2eDqPZf02_f6ZnzuNf3VwrfaJBsCKhRB_BGapf3Ohh5vR6EWRCi7XRaahSF-LwVVlAidKlRgJ9RVtYs1_cveQt9Ia1bZmi869aOdK5lpurCAvxls48XP1F-N7jyoF9yWHKOQHU69JW1Q Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Role: member,admin,reader Jun 15 00:34:00.570887 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Roles: member,admin,reader Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant: admin Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User: admin Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Name: admin Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: method: > Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: exception: Flavor 84 could not be found. Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: action_args: {'id': '84'} Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:34:00.572382 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:00.573371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.575449 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-d797bbfb-be1d-4c0f-a8a3-5f8152cdf288 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:34:00.576935 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-d797bbfb-be1d-4c0f-a8a3-5f8152cdf288 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063548 Jun 15 00:34:00.576935 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jun 15 00:34:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:00.582401 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-392f13bb-b6b2-496e-b1d7-072af114da5f admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:00.597285 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-392f13bb-b6b2-496e-b1d7-072af114da5f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018474 Jun 15 00:34:00.597793 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:00.607276 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-fc6d748c-9454-4091-9b80-5c4aeec2b65e admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:00.620550 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-fc6d748c-9454-4091-9b80-5c4aeec2b65e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017126 Jun 15 00:34:00.621048 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:34:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:00.630270 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-9b9f74d6-8473-4ca1-8109-4f8d84bba199 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:00.635473 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.wsgi [None req-9b9f74d6-8473-4ca1-8109-4f8d84bba199 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-9b9f74d6-8473-4ca1-8109-4f8d84bba199 admin admin] Request method failure captured: Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept: application/json Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept-Encoding: gzip, deflate Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Connection: keep-alive Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Content-Length: 0 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Host: 10.222.0.17 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-Api-Version: compute 2.90 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-System-Scope: None Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: User-Agent: python-novaclient Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Auth-Token: gAAAAABiqSj4_tNA8fl8gcyCn0ZEnFwRS7gSXUGF-7M2eDqPZf02_f6ZnzuNf3VwrfaJBsCKhRB_BGapf3Ohh5vR6EWRCi7XRaahSF-LwVVlAidKlRgJ9RVtYs1_cveQt9Ia1bZmi869aOdK5lpurCAvxls48XP1F-N7jyoF9yWHKOQHU69JW1Q Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Id: None Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Name: None Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Identity-Status: Confirmed Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Is-Admin-Project: True Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Id: default Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Name: Default Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Name: admin Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Role: member,admin,reader Jun 15 00:34:00.637910 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Roles: member,admin,reader Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant: admin Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Name: admin Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User: admin Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Id: default Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Name: Default Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Name: admin Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: method: > Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: exception: Flavor 84 could not be found. Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: action_args: {'id': '84'} Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:34:00.639514 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:00.640550 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:00.641887 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-9b9f74d6-8473-4ca1-8109-4f8d84bba199 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:34:00.643335 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-9b9f74d6-8473-4ca1-8109-4f8d84bba199 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012361 Jun 15 00:34:00.643335 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Jun 15 00:34:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 00:34:01.494670 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-fc6d748c-9454-4091-9b80-5c4aeec2b65e admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:01.495650 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-fc6d748c-9454-4091-9b80-5c4aeec2b65e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Jun 15 00:34:01.496073 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:01.686817 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-01387f15-0c7c-4e95-be02-1f909f165a74 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:01.692262 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.wsgi [None req-01387f15-0c7c-4e95-be02-1f909f165a74 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-01387f15-0c7c-4e95-be02-1f909f165a74 admin admin] Request method failure captured: Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept: application/json Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Accept-Encoding: gzip, deflate Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Connection: keep-alive Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Content-Length: 0 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Host: 10.222.0.17 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-Api-Version: compute 2.90 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Openstack-System-Scope: None Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: User-Agent: python-novaclient Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Auth-Token: gAAAAABiqSj5dh7KmDCWnqZyyRcd_oy6UHyvmhmNlep092-OLD1ekTXvipRxct-couue6Nd6umoXeOw_jpM4ByONIiJVaAIsKBCKCj_0Y96b_dErkP4iPDTxQ8a4PGgJyZy9NZGzNeO9p-bB_26DMtbAu2DT7GcYQqEz8ptgxHUYaWa7a5nOBOs Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Id: None Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Domain-Name: None Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Identity-Status: Confirmed Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Is-Admin-Project: True Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Id: default Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Domain-Name: Default Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Project-Name: admin Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Role: member,admin,reader Jun 15 00:34:01.693743 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Roles: member,admin,reader Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant: admin Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-Tenant-Name: admin Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User: admin Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Id: default Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Domain-Name: Default Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: X-User-Name: admin Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: method: > Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: exception: Flavor 451 could not be found. Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: action_args: {'id': '451'} Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:34:01.695331 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:01.696231 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.697256 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-01387f15-0c7c-4e95-be02-1f909f165a74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:34:01.698234 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-01387f15-0c7c-4e95-be02-1f909f165a74 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059557 Jun 15 00:34:01.698234 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:34:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:01.705350 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-fcc1c438-0c6d-4c0b-9639-73f53965f537 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:01.719371 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-fcc1c438-0c6d-4c0b-9639-73f53965f537 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017716 Jun 15 00:34:01.719885 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:01.729606 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:01.743306 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017551 Jun 15 00:34:01.743857 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Jun 15 00:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:01.753837 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a726a77e-10f1-4223-b115-a294869bc75e admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:01.759169 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.wsgi [None req-a726a77e-10f1-4223-b115-a294869bc75e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a726a77e-10f1-4223-b115-a294869bc75e admin admin] Request method failure captured: Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept: application/json Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Accept-Encoding: gzip, deflate Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Connection: keep-alive Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Content-Length: 0 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Host: 10.222.0.17 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-Api-Version: compute 2.90 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Openstack-System-Scope: None Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: User-Agent: python-novaclient Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Auth-Token: gAAAAABiqSj5dh7KmDCWnqZyyRcd_oy6UHyvmhmNlep092-OLD1ekTXvipRxct-couue6Nd6umoXeOw_jpM4ByONIiJVaAIsKBCKCj_0Y96b_dErkP4iPDTxQ8a4PGgJyZy9NZGzNeO9p-bB_26DMtbAu2DT7GcYQqEz8ptgxHUYaWa7a5nOBOs Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Id: None Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Domain-Name: None Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Identity-Status: Confirmed Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Is-Admin-Project: True Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Id: default Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Domain-Name: Default Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Project-Name: admin Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Role: member,admin,reader Jun 15 00:34:01.760683 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Roles: member,admin,reader Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ef6352e5d076419cbaba12161ca4f129", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ef6352e5d076419cbaba12161ca4f129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ef6352e5d076419cbaba12161ca4f129"}]}] Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant: admin Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Id: ef6352e5d076419cbaba12161ca4f129 Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-Tenant-Name: admin Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User: admin Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Id: default Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Domain-Name: Default Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Id: c25537e8f9b64e58ba6db076b2ad8db7 Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: X-User-Name: admin Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: method: > Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: exception: Flavor 451 could not be found. Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: action_args: {'id': '451'} Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:34:01.763067 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:01.764139 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: ERROR nova.api.openstack.wsgi Jun 15 00:34:01.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-a726a77e-10f1-4223-b115-a294869bc75e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:34:01.766825 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-a726a77e-10f1-4223-b115-a294869bc75e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011990 Jun 15 00:34:01.766825 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:34:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:02.625117 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:02.626124 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 15 00:34:02.626513 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:02.818374 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-21e14ae4-bb88-4287-a64f-63cf465885c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:34:02.882760 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-21e14ae4-bb88-4287-a64f-63cf465885c1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.115204 Jun 15 00:34:02.883228 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jun 15 00:34:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:34:03.735883 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:03.736899 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 15 00:34:03.737285 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:03.925551 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-dce61062-fb1b-4c1c-bac2-e393922b2850 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:34:04.063803 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-dce61062-fb1b-4c1c-bac2-e393922b2850 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.189244 Jun 15 00:34:04.064368 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jun 15 00:34:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:34:04.926107 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:04.927100 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Jun 15 00:34:04.927482 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:05.114676 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-4599bb9d-b367-4a57-baa6-67cef1069a68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:34:05.224013 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-4599bb9d-b367-4a57-baa6-67cef1069a68 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.159192 Jun 15 00:34:05.224519 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jun 15 00:34:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:34:06.087997 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:06.088991 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 15 00:34:06.089375 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:06.276725 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-09abb39c-e361-4227-a856-ff8a7a66974d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:34:06.355423 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-09abb39c-e361-4227-a856-ff8a7a66974d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.129339 Jun 15 00:34:06.355882 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Jun 15 00:34:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:34:07.222704 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:07.223713 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 15 00:34:07.224133 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:07.412694 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3d000ce7-b3af-4659-a784-d7a2164ef172 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:07.431195 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-3d000ce7-b3af-4659-a784-d7a2164ef172 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070010 Jun 15 00:34:07.431712 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Jun 15 00:34:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:55.144473 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.145476 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-62310f1e-caa9-4944-8b8a-2423b87446ae admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 15 00:34:55.145855 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:34:55.155851 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:55.203001 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-2eb178c4-c0bf-43e6-b33a-626393838764 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.221888 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-2eb178c4-c0bf-43e6-b33a-626393838764 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070472 Jun 15 00:34:55.222416 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:34:55.245441 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-af21d4df-71e4-4ce6-b5b6-5a5c19448034 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.248883 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG dbcounter [-] [110311] Writing DB stats nova_api:SELECT=14 {{(pid=110311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:55.253712 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-af21d4df-71e4-4ce6-b5b6-5a5c19448034 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012361 Jun 15 00:34:55.254212 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:34:55.266442 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-32560559-5bec-478b-8f59-a9144a0dfbb5 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.274002 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-32560559-5bec-478b-8f59-a9144a0dfbb5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011359 Jun 15 00:34:55.274496 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:34:55.285784 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.293365 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011053 Jun 15 00:34:55.293866 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:34:55.304652 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-de7a0f73-3e3e-4ccc-b8fc-f5549a961204 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:34:55.312522 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-de7a0f73-3e3e-4ccc-b8fc-f5549a961204 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011242 Jun 15 00:34:55.313021 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Jun 15 00:34:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:38:12.762807 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:12.763807 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 15 00:38:12.764235 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:38:12.919597 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=6 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:13.031189 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:13.032378 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:38:13.032378 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:38:13.033552 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:13.033985 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:13.034756 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:13.035175 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:13.069030 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-742d2431-6b3f-4190-84e4-509b9ffaf3d4 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150947 Jun 15 00:38:13.069566 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:38:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:38:13.928226 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:13.929232 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 15 00:38:13.929640 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:38:14.119833 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:14.121121 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:38:14.121121 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:38:14.122333 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:14.122763 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:14.123534 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:14.123974 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:14.143425 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-cf697e5e-d1db-42e2-a6d9-fbb194a3605c admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073862 Jun 15 00:38:14.143959 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:38:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:38:25.428674 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:25.429688 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 15 00:38:25.430068 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:38:25.573077 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell0:SELECT=4 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:25.573794 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_cell1:SELECT=4 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:25.574396 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG dbcounter [-] [110310] Writing DB stats nova_api:SELECT=8 {{(pid=110310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:25.621344 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:25.622556 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:38:25.622556 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:38:25.623680 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:25.624163 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:25.624943 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:25.625418 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:25.650987 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-3e6d637e-2c40-4a40-8c4f-d3ebc94967ab admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082302 Jun 15 00:38:25.651526 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:38:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:38:26.516956 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: DEBUG nova.api.openstack.wsgi [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] Calling method '>' {{(pid=110311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:26.517956 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: INFO nova.api.openstack.requestlog [None req-4d576663-c789-409a-bf5e-7ed839557140 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 15 00:38:26.518348 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: [pid: 110311|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Jun 15 00:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:38:26.707856 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG nova.api.openstack.wsgi [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] Calling method '>' {{(pid=110310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:38:26.709034 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:38:26.709034 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: warnings.warn(msg) Jun 15 00:38:26.710201 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:26.710631 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:26.711399 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:38:26.711819 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: DEBUG oslo_concurrency.lockutils [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:38:26.732873 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: INFO nova.api.openstack.requestlog [None req-7cb3158c-d85f-4011-9de6-da4cf90e2eb5 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.075701 Jun 15 00:38:26.733603 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: [pid: 110310|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Jun 15 00:38:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:39:23.264200 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: Wed Jun 15 00:39:23 2022 - graceful shutdown triggered... Jun 15 00:39:23.264436 dv-cinder-845178-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 00:39:23.265108 dv-cinder-845178-5-iscsi devstack@n-api.service[110311]: Gracefully killing worker 2 (pid: 110311)... Jun 15 00:39:23.266032 dv-cinder-845178-5-iscsi devstack@n-api.service[110310]: Gracefully killing worker 1 (pid: 110310)... Jun 15 00:39:24.264911 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: worker 1 buried after 1 seconds Jun 15 00:39:24.265452 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: worker 2 buried after 1 seconds Jun 15 00:39:24.265452 dv-cinder-845178-5-iscsi devstack@n-api.service[110309]: goodbye to uWSGI. Jun 15 00:39:24.266466 dv-cinder-845178-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 00:39:24.267048 dv-cinder-845178-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 00:39:24.269934 dv-cinder-845178-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 00:39:24.279064 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 00:39:24.281638 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 00:39:24 2022] *** Jun 15 00:39:24.281798 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 00:39:24.281947 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 00:39:24.282064 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: nodename: dv-cinder-845178-5-iscsi Jun 15 00:39:24.282183 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: machine: x86_64 Jun 15 00:39:24.282296 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: clock source: unix Jun 15 00:39:24.282403 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: pcre jit disabled Jun 15 00:39:24.282513 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: detected number of CPU cores: 4 Jun 15 00:39:24.282623 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: current working directory: / Jun 15 00:39:24.282731 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: detected binary path: /usr/bin/uwsgi-core Jun 15 00:39:24.282847 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: your processes number limit is 47680 Jun 15 00:39:24.282975 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: your memory page size is 4096 bytes Jun 15 00:39:24.283089 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: detected max file descriptor number: 2048 Jun 15 00:39:24.283200 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: lock engine: pthread robust mutexes Jun 15 00:39:24.283489 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: thunder lock: enabled Jun 15 00:39:24.283798 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 00:39:24.283990 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 00:39:24.328458 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: Python main interpreter initialized at 0x55970dd829c0 Jun 15 00:39:24.328458 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: python threads support enabled Jun 15 00:39:24.328458 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: your server socket listen backlog is limited to 100 connections Jun 15 00:39:24.328458 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: your mercy for graceful operations on workers is 90 seconds Jun 15 00:39:24.328906 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 00:39:24.328906 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: *** Operational MODE: preforking *** Jun 15 00:39:24.329187 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: *** uWSGI is running in multiple interpreter mode *** Jun 15 00:39:24.329187 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: spawned uWSGI master process (pid: 124662) Jun 15 00:39:24.329399 dv-cinder-845178-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 00:39:24.330074 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: spawned uWSGI worker 1 (pid: 124682, cores: 1) Jun 15 00:39:24.330306 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: spawned uWSGI worker 2 (pid: 124683, cores: 1) Jun 15 00:39:24.331102 dv-cinder-845178-5-iscsi devstack@n-api.service[124662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 00:39:24.989672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 00:39:24.990331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 00:39:26.241845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:39:26.241845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: from cryptography.utils import int_from_bytes Jun 15 00:39:26.242572 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:39:26.242572 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: from cryptography.utils import int_from_bytes Jun 15 00:39:26.243002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:39:26.243002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: from cryptography.utils import int_from_bytes Jun 15 00:39:26.243151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:39:26.243151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: from cryptography.utils import int_from_bytes Jun 15 00:39:28.641774 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:39:28.642614 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:39:28.643293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:39:28.643686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:39:28.643976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:39:28.644369 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.644699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.645027 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.645348 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.645638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:39:28.646033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.646121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:39:28.646205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.646284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.646477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:39:28.646586 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.646778 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:39:28.646884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.647027 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:39:28.647130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.647417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.647527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.647741 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.647842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-5-iscsi {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648719 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.648825 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649663 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.649968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.650077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.650307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.650471 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.650636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.650944 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-5-iscsi {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.651272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.651730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.651974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.652099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.652292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.652521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.652764 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.652974 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.653217 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.653431 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.653636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.653840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.653840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.654249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.654249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.654669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.654902 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.655143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.655364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.655577 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.655796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.656029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.656229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.656474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-5-iscsi {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.657411 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.657577 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.657757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.657923 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658731 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.658882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.659022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-5-iscsi {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.659175 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.659454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.659616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.659824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.660900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.661040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.661259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.662273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.662484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.662663 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.662813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.662980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663708 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.663853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.664056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.664698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.664698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.664998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665318 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665461 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.665896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666045 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666198 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666639 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666786 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.666935 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667094 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.667827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668916 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.668916 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669489 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669639 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.669925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670368 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670368 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670655 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.670950 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.671098 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.671252 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.671400 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.671540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.671540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.672615 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.672725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.672824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.672915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.672998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673174 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.673963 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674402 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674654 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.674840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.675955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676156 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676761 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.676938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677286 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677462 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677648 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677816 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.677994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678088 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678464 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678562 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678654 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678746 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.678925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679101 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679283 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679376 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679593 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.679926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680228 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.680964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681563 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.681927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682377 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682683 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.682986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683077 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.683898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.684933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685227 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.685835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686045 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686450 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.686958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687670 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.687985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.688197 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.688302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.688502 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.688609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.688803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.688903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.689120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.689221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.689440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.689533 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.689749 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.689845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.690057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.690158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.690364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.690464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.691285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.691388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:39:28.691603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.691702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.691952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.692993 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693319 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.693940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694266 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.694882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695102 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.695823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696175 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.696835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697202 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697774 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.697974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698414 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.698933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699064 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699562 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699693 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.699875 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.700209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.700518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.700829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.702298 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.702481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.702636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.702784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.702930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703075 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703634 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.703864 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.704842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.704842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705484 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705601 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705895 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.705990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706283 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706801 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.706986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707077 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707630 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.707807 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708001 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.708943 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.709871 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710328 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710632 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.710947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711153 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.711934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712144 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712297 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.712900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713080 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713208 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713705 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.713798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714018 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714648 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.714946 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715352 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.715861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.716904 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.717804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718105 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.718868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719808 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.719947 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.720915 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721452 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721572 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.721880 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722400 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722708 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.722843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.723940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724344 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724667 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.724976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.725987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726333 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726644 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.726988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.727113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.727327 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.727418 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.727649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.727749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728423 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.728957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729267 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729680 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729889 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.729992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730606 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730817 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.730918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731532 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731755 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.731858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732720 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.732826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733150 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733470 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.733992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734095 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734611 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734707 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.734918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.735995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.736179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.736281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.738531 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739302 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739374 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739442 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739598 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.739941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740285 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740363 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.740960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741030 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741175 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741252 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741322 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.741946 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742253 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.742873 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743165 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.743986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.744922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745230 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.745862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746171 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.746979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747285 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.747940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748036 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748622 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.748934 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749368 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749677 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.749877 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750612 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.750898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751108 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751534 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751731 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.751851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752078 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.752806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.753018 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.753658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.753871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.753971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.754927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755141 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755547 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.755857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756494 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.756790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757368 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757601 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757902 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.757994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758308 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.758944 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759448 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.759853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.760075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.760184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.760419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761163 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761664 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.761924 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762235 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.762941 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.763848 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764178 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764693 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.764794 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.765001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.765107 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.765306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.765424 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766211 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766772 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.766966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767359 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.767981 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768402 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768542 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768826 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.768917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769803 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.769896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.770803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771381 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.771931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772241 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772343 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772543 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772635 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.772941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773455 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773756 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.773849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774772 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.774969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775070 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.775877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776213 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776612 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.776920 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777422 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.777866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778805 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.778947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.779887 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.780075 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.793876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794151 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794235 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794809 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.794900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795335 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795597 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795763 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.795854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.796919 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797112 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797199 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797283 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797374 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797552 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797743 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.797928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798017 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798112 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798204 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798291 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798906 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.798992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799628 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.799817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.800440 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.800589 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.800714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.800845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.800958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801414 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801631 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.801996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802476 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802812 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802904 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.802989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803236 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803322 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.803864 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804048 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804231 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804496 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804705 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804813 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.804991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805637 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805716 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805800 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.805977 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806237 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806920 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.806989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807623 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.807866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808389 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808627 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.808988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809072 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809332 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809506 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809675 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809768 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809860 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.809952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810037 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810213 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810401 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810587 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.810956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811124 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811423 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.811936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.812020 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.813893 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.813998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814557 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814657 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814657 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.814972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815164 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815250 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815335 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815508 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.815643 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816663 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816776 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.816899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817040 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817307 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817580 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817858 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.817951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818362 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818736 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.818912 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819096 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.819967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820484 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820659 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.820939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821412 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821696 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.821933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822574 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822660 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.822929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823500 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823592 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.823974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824569 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824809 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.824922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.825867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826183 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826494 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.826822 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827348 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827441 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.827998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828108 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.828931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829236 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829643 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.829936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.830167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.830266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.830544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.830714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.830853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831261 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831405 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831580 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.831889 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832231 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.832999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833605 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833808 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.833910 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.834882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835089 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835497 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835708 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.835815 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836044 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836677 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.836996 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837098 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837297 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.837920 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838233 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838635 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.838850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839073 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839510 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839719 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.839820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840463 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840681 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.840782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841027 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.841915 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842036 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.842896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843503 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.843993 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844156 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.844952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845578 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.845896 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846381 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.846823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.847771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848596 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848705 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.848940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849509 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.849936 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850467 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850774 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.850867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.851943 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852047 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852733 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.852908 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853039 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853362 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853676 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.853926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854142 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854240 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854545 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.854853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.855995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856094 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.856907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857791 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.857885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858250 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858728 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.858849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859658 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.859989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.860938 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861041 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861248 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861642 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.861969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.862177 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.862325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863301 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863609 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.863969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.864934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.865867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866175 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.866996 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867710 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.867940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868358 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.868957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869264 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869477 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.869885 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870090 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870489 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870709 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.870816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871033 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.871775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872097 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872887 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.872988 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.873930 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874154 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874561 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.874856 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875712 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.875806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876361 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.876981 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.877918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.878019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.878782 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.878887 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879554 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.879862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880090 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.880791 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881105 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881719 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.881929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882030 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882230 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882637 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882839 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.882933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883142 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883302 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883650 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.883832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884496 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884631 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.884916 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.885135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.885230 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.885459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.885552 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886441 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.886951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887044 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887658 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.887992 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.888955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889485 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.889870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890392 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.890804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891008 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891101 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.891994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892254 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892863 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.892955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893300 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893466 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.893954 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894095 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.894969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895379 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895690 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.895886 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896069 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896210 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896304 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.896910 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897761 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.897855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898080 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.898804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899021 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899328 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.899985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.900934 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901028 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901352 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.901974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.902170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.902271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.902414 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:39:28.902508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.902791 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.903118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.903424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.903748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.904093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.904413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.904730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.905045 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.905374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.905687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.905999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.906316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.906629 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.906941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.907265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.907582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.907933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.908256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.908568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.908894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.909223 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.909596 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.909908 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.910250 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.910577 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.910891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.911203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.911507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:39:28.911752 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:39:28.965656 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Registered counter for database nova_api Jun 15 00:39:28.975583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Registered counter for database nova_api Jun 15 00:39:28.985900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:28.992635 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:28.994911 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.001390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.049671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.context [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6dffbe-391d-463b-94f8-73114df29399(cell1) {{(pid=124683) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 00:39:29.053798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:39:29.055358 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:39:29.056163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:39:29.058082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:39:29.058209 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.context [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6dffbe-391d-463b-94f8-73114df29399(cell1) {{(pid=124682) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 00:39:29.060076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Registered counter for database nova_cell0 Jun 15 00:39:29.062323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:39:29.063940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:39:29.064091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Registered counter for database nova_cell1 Jun 15 00:39:29.064714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:39:29.070405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:39:29.070405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Registered counter for database nova_cell0 Jun 15 00:39:29.072997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.073706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Registered counter for database nova_cell1 Jun 15 00:39:29.074876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.080851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.082278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.083682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.084651 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.091659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.093440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.233069 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO dbcounter [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Registered counter for database nova_cell0 Jun 15 00:39:29.239991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_db.sqlalchemy.engines [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.247473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writer thread running {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.251886 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO dbcounter [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Registered counter for database nova_cell0 Jun 15 00:39:29.259192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_db.sqlalchemy.engines [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:39:29.264069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writer thread running {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:39:29.573121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:39:29.580246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:39:29.580482 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:39:29.588028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:39:29.929336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:39:29.929929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 00:39:29.935164 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: WARNING keystonemiddleware.auth_token [None req-bdf2afd6-3a97-4594-816b-2a6a6b445db3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:39:29.935765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: WARNING keystonemiddleware.auth_token [None req-69cc6c49-8885-45c1-804e-2b2fc5f3aa14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 00:39:29.940450 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55970dd829c0 pid: 124682 (default app) Jun 15 00:39:29.941617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55970dd829c0 pid: 124683 (default app) Jun 15 00:40:08.714566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.715551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.716103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.717048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.141064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a573cee5-a462-4223-a85c-ed20046ca090 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Action: 'create', calling method: .version_select at 0x7fa8257d6820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1536762116", "metadata": {"Type": "work"}}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a573cee5-a462-4223-a85c-ed20046ca090 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 122 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:40:10.159743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1536762116", "metadata": {"Type": "work"}}} Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: Jun 15 00:40:10.161132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1536762116', 'metadata': {'Type': 'work'}}}} Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise error Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:10.161984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 00:40:10.163276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 00:40:10.164459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 00:40:10.164459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.164459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a573cee5-a462-4223-a85c-ed20046ca090 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:10.164459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a573cee5-a462-4223-a85c-ed20046ca090 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.461794 Jun 15 00:40:10.164459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jun 15 00:40:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1464 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:40:10.381482 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-44c3e768-e345-45e8-9bce-afd5f34f8e58 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Action: 'create', calling method: .version_select at 0x7fa82581e0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313412772", "metadata": {"Type": "work"}}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-44c3e768-e345-45e8-9bce-afd5f34f8e58 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 120 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:40:10.385490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313412772", "metadata": {"Type": "work"}}} Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:40:10.391148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1313412772', 'metadata': {'Type': 'work'}}}} Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise error Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi '0' Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:10.392370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 00:40:10.393717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 00:40:10.394811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 00:40:10.394811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.394811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-44c3e768-e345-45e8-9bce-afd5f34f8e58 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:10.394811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-44c3e768-e345-45e8-9bce-afd5f34f8e58 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.219352 Jun 15 00:40:10.394811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jun 15 00:40:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:40:10.400300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fcd40585-aef2-4b53-93e1-9fce347b80db tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Action: 'create', calling method: .version_select at 0x7fa8257eaaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1241538026", "metadata": {"Type": "work"}}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fcd40585-aef2-4b53-93e1-9fce347b80db tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 119 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:40:10.404729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1241538026", "metadata": {"Type": "work"}}} Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: Jun 15 00:40:10.406029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1241538026', 'metadata': {'Type': 'work'}}}} Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise error Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi '' Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:10.406795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 00:40:10.408599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 00:40:10.410552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 00:40:10.410552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:40:10.410552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fcd40585-aef2-4b53-93e1-9fce347b80db tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:10.410552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fcd40585-aef2-4b53-93e1-9fce347b80db tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016708 Jun 15 00:40:10.411006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jun 15 00:40:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:40:10.418823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.418823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.419012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.419894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.424932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a97fbc86-2138-489a-be43-80d84c4f3c57 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Calling method '.version_select at 0x7fa82581e160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:11.209360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4f0a9181-3d49-4f0a-8dc3-e0661b1c1020 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Action: 'create', calling method: .version_select at 0x7fa8257d6c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1067631051", "metadata": {"Type": "work"}}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:11.966858 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-a97fbc86-2138-489a-be43-80d84c4f3c57 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] HTTP exception thrown: Volume tempest-invalid-458279672 could not be found. Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a97fbc86-2138-489a-be43-80d84c4f3c57 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-458279672 HTTP/1.1 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:40:11.971724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Volume tempest-invalid-458279672 could not be found. Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'tempest-invalid-458279672'} Jun 15 00:40:11.973240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-458279672 could not be found. (HTTP 404) (Request-ID: req-2b90cdb6-33d3-410d-82df-f6e86e8e0f09) Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:11.974153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:40:11.975444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-458279672 could not be found. Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:40:11.976885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-458279672 could not be found. Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-458279672 could not be found. Jun 15 00:40:11.978223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:11.979746 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a97fbc86-2138-489a-be43-80d84c4f3c57 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 404 to user: Volume tempest-invalid-458279672 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:11.981410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a97fbc86-2138-489a-be43-80d84c4f3c57 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-458279672" status: 404 len: 98 microversion: 2.1 time: 1.564697 Jun 15 00:40:11.982106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1214 bytes} [Wed Jun 15 00:40:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-458279672 => generated 98 bytes in 1566 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 00:40:11.993502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8786dec9-a1e9-4e04-917c-60c4bfd02633 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004832 Jun 15 00:40:11.994145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jun 15 00:40:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 00:40:12.003126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-27179299-5d48-425f-b9e4-9708adab84c2 tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003756 Jun 15 00:40:12.003785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1136 bytes} [Wed Jun 15 00:40:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 00:40:12.034389 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-184c819a-2482-404f-abce-2ae12acf09aa tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Calling method '.version_select at 0x7fa82581ef70>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:12.092718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-184c819a-2482-404f-abce-2ae12acf09aa tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] HTTP exception thrown: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-184c819a-2482-404f-abce-2ae12acf09aa tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/os-volumes/a4d4f505-01ca-4903-bcca-b6b0f1cc3565 HTTP/1.1 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:40:12.095770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'a4d4f505-01ca-4903-bcca-b6b0f1cc3565'} Jun 15 00:40:12.097107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. (HTTP 404) (Request-ID: req-73747ddc-3103-4acb-bf0e-31fa237dc5c5) Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.097861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:40:12.098952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 00:40:12.101861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-184c819a-2482-404f-abce-2ae12acf09aa tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 404 to user: Volume a4d4f505-01ca-4903-bcca-b6b0f1cc3565 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-184c819a-2482-404f-abce-2ae12acf09aa tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/a4d4f505-01ca-4903-bcca-b6b0f1cc3565" status: 404 len: 109 microversion: 2.1 time: 0.088683 Jun 15 00:40:12.104605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 5/7] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:40:12 2022] DELETE /compute/v2.1/os-volumes/a4d4f505-01ca-4903-bcca-b6b0f1cc3565 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:40:12.109846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b8621d7a-e966-4d3c-9a1f-295fbeae1a8e tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Calling method '.version_select at 0x7fa825657a60>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:12.175685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-b8621d7a-e966-4d3c-9a1f-295fbeae1a8e tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] HTTP exception thrown: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b8621d7a-e966-4d3c-9a1f-295fbeae1a8e tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Request method failure captured: Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/os-volumes/7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d HTTP/1.1 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpoZJ27mgdaBM3aNwlmw1cSnR-REdjCwHk4IWz1TL2p7lA7Inn-ouGAzOrFXnOLFLI884-UU9sC9yltIzg-YlFN5TS6EIPm44HnxNJnewycpuYdD2_E4uGAe_86nqjrFjB0VOEuURRLOY7PoFIl8unoPqlEwrsQ6elpK0cto9Lc0aY Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:40:12.177345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e1466c2e8504a34812a807bb0d1f077", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e1466c2e8504a34812a807bb0d1f077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e1466c2e8504a34812a807bb0d1f077"}]}] Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 1e1466c2e8504a34812a807bb0d1f077 Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesNegativeTest-1058909347 Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: a46c4b99af5d48a98148392d95e89f1a Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesNegativeTest-1058909347-project Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d'} Jun 15 00:40:12.178810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. (HTTP 404) (Request-ID: req-8525aa9d-b13a-4442-9354-e7db81ce525a) Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.179573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:40:12.180752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 00:40:12.181840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. Jun 15 00:40:12.182907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:12.185192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b8621d7a-e966-4d3c-9a1f-295fbeae1a8e tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] Returning 404 to user: Volume 7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:12.186292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b8621d7a-e966-4d3c-9a1f-295fbeae1a8e tempest-VolumesNegativeTest-1058909347 tempest-VolumesNegativeTest-1058909347-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d" status: 404 len: 109 microversion: 2.1 time: 0.082449 Jun 15 00:40:12.187205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 6/8] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:12 2022] GET /compute/v2.1/os-volumes/7cc1b6c3-a8d5-495d-9d30-4fed74f5c56d => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:40:13.453457 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4f0a9181-3d49-4f0a-8dc3-e0661b1c1020 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.508251 Jun 15 00:40:13.454551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 3/9] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Jun 15 00:40:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2510 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 15 00:40:13.467534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a65ecf4-6068-4242-9d2f-f9ccdb4f6cf6 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa825669160>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:13.709590 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a65ecf4-6068-4242-9d2f-f9ccdb4f6cf6 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 200 len: 353 microversion: 2.1 time: 0.247083 Jun 15 00:40:13.710123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 4/10] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:13 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:13.723588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-889724297", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "networks": [{"uuid": "87533440-552b-4c8c-9f37-b37d946f5020"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:13.954695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] validate_networks() for [('87533440-552b-4c8c-9f37-b37d946f5020', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:40:14.763711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2e142d8a-6a71-45e8-8093-537d73f4199a tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa825669820>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:14.801656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2e142d8a-6a71-45e8-8093-537d73f4199a tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 200 len: 353 microversion: 2.1 time: 0.082739 Jun 15 00:40:14.802212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 5/11] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:14 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:15.642949 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:40:15.645020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:40:15.645020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:40:15.645944 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:40:15.646661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:40:15.709660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:15.712709 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:15.741124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:15.744259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:15.815159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1297bb59-a88c-4206-bd4a-89c0106b0c1f tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa825669940>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:15.921611 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Getting quotas for project 7c72ff79bb364f0d9bc9d9397abd5318. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:15.929083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Getting quotas for user 4acef8b517cc41e684dfa9b3a765edb8 and project 7c72ff79bb364f0d9bc9d9397abd5318. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:15.958287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:40:15.961953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:40:16.151342 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b3a01cce-3d0d-4eb3-a557-1f1fa0ddaf32 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.703982 Jun 15 00:40:16.154965 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 7/12] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:40:16.163786 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-947dcf67-57b0-4aae-b399-742e9a6ccde6 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:16.164650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-947dcf67-57b0-4aae-b399-742e9a6ccde6 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:16.312204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-947dcf67-57b0-4aae-b399-742e9a6ccde6 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:16.343947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-947dcf67-57b0-4aae-b399-742e9a6ccde6 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1214 microversion: 2.1 time: 0.180805 Jun 15 00:40:16.349666 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 8/13] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:16 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:16.465316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1297bb59-a88c-4206-bd4a-89c0106b0c1f tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 200 len: 354 microversion: 2.1 time: 0.653118 Jun 15 00:40:16.472879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 6/14] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:15 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 354 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:40:16.481118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-af2a9b00-c8e2-4ae1-9038-e1d4e92cd858 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa824d2f940>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:16.677962 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-af2a9b00-c8e2-4ae1-9038-e1d4e92cd858 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 200 len: 354 microversion: 2.1 time: 0.203691 Jun 15 00:40:16.684516 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 9/15] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:16 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:16.692292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79581ce2-eafa-49bb-8a06-318d7b3e8242 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa8256693a0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:17.365203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c06d7392-7619-4174-9e7d-c3257b8e7b06 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:17.368602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c06d7392-7619-4174-9e7d-c3257b8e7b06 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:17.452579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c06d7392-7619-4174-9e7d-c3257b8e7b06 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:17.461977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c06d7392-7619-4174-9e7d-c3257b8e7b06 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1214 microversion: 2.1 time: 0.101001 Jun 15 00:40:17.462558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 10/16] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:17 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:17.627835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-79581ce2-eafa-49bb-8a06-318d7b3e8242 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 202 len: 0 microversion: 2.1 time: 0.941380 Jun 15 00:40:17.631353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 7/17] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:40:16 2022] DELETE /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:40:17.637059 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8ffed8a0-942e-42e7-b71b-dc10400ce5d2 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa8244e3c10>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:17.740602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8ffed8a0-942e-42e7-b71b-dc10400ce5d2 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 200 len: 353 microversion: 2.1 time: 0.107919 Jun 15 00:40:17.741395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 11/18] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:17 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:18.480295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-02085b12-fe44-414d-a3f3-31da26356b9f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:18.483828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-02085b12-fe44-414d-a3f3-31da26356b9f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:18.626257 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-02085b12-fe44-414d-a3f3-31da26356b9f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:18.655975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-02085b12-fe44-414d-a3f3-31da26356b9f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1214 microversion: 2.1 time: 0.179891 Jun 15 00:40:18.674994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 8/19] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:18 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:18.753207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9023cbd4-cdb6-4559-b913-ce7caa9aaa31 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Calling method '.version_select at 0x7fa8244d1550>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:18.823861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-9023cbd4-cdb6-4559-b913-ce7caa9aaa31 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] HTTP exception thrown: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9023cbd4-cdb6-4559-b913-ce7caa9aaa31 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Request method failure captured: Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 HTTP/1.1 Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpqgACh26Gmlq63DcUbZwjUCYvI_E7wy86OnP74jttNDt6miLLE4GDoyfyQyhtP14Lz11izP8VInx666ZAIOqHWQhs2TGHaMTQgG0Dk_wpArxfivyb5ecqE5VQBD6ru734AFgX83vGdR7y3bCOjLgNnyd_y53x-9tVlrUq99XeIP1M Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: d5d0b6a397e844c0b4260544cd69dfee Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesGetTestJSON-393265060 Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:40:18.826079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d5d0b6a397e844c0b4260544cd69dfee", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d5d0b6a397e844c0b4260544cd69dfee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d5d0b6a397e844c0b4260544cd69dfee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d5d0b6a397e844c0b4260544cd69dfee"}]}] Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesGetTestJSON-393265060 Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: d5d0b6a397e844c0b4260544cd69dfee Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesGetTestJSON-393265060 Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesGetTestJSON-393265060-project Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 927eff6c108d424db27862b86671c15a Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesGetTestJSON-393265060-project Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '74a02193-733e-4777-84a3-3756ab5f26c5'} Jun 15 00:40:18.827428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. (HTTP 404) (Request-ID: req-c40d64f0-b202-40fa-8300-2592176228ef) Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:18.828269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:40:18.829921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 00:40:18.831121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9023cbd4-cdb6-4559-b913-ce7caa9aaa31 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] Returning 404 to user: Volume 74a02193-733e-4777-84a3-3756ab5f26c5 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:40:18.833479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9023cbd4-cdb6-4559-b913-ce7caa9aaa31 tempest-VolumesGetTestJSON-393265060 tempest-VolumesGetTestJSON-393265060-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5" status: 404 len: 109 microversion: 2.1 time: 0.084684 Jun 15 00:40:18.834268 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 12/20] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:18 2022] GET /compute/v2.1/os-volumes/74a02193-733e-4777-84a3-3756ab5f26c5 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:40:19.694136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:19.694136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:19.694136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:19.694136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:19.695036 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:19.695036 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:20.097877 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:20.127100 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94e2005e-bb83-4929-95cc-1e69a6af5adf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1218 microversion: 2.1 time: 0.457570 Jun 15 00:40:20.129109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 9/21] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:19 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1218 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:21.146792 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:21.149242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:21.163755 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:21.164567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:21.165615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:21.166513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:21.530117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:21.557546 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-884449ec-3ca6-4410-a90d-7492b392770b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1266 microversion: 2.1 time: 0.417018 Jun 15 00:40:21.559037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 13/22] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:21 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:22.577553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:22.579571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:22.591721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:22.592278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:22.594964 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:22.597810 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:22.981309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:22.990137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7fcf3c9d-e18f-4ee2-9c1d-b112b53c6fef tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1266 microversion: 2.1 time: 0.417285 Jun 15 00:40:22.998599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 10/23] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:22 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:23.374936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5ffc9101-310d-4346-87e1-cd2de4e54566 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: .version_select at 0x7fa82440fca0>, body: {"keypair": {"name": "tempest-keypair-418457759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaOEaHUz7d7kfI5+OtVUp8djZeyhjIFZ5/xMUelkzkP+bcr7SrnoHZP1h317JISEMFfiqGYYeCZtkxDed8x/iHe3jHkxYKr6Z68VOR++mNNrjCX/W+99nG+Vu2DSkcOIw=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:23.401279 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-5ffc9101-310d-4346-87e1-cd2de4e54566 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for project 30f2ff4320764a69bb987d567aed9201. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:23.407463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-5ffc9101-310d-4346-87e1-cd2de4e54566 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for user d9a0bbb1f50c42acb50dac254a653da4 and project 30f2ff4320764a69bb987d567aed9201. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:23.557351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5ffc9101-310d-4346-87e1-cd2de4e54566 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.601744 Jun 15 00:40:23.557658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 14/24] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:40:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:40:24.015131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:24.017189 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:24.046306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:24.047669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:24.052319 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:24.054698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:24.340310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:24.351110 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d87dbafa-064c-4c44-a0f3-4f2a0fbb8449 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1274 microversion: 2.1 time: 0.340360 Jun 15 00:40:24.357309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 11/25] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:24 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1274 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:24.896900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0ab64d05-3412-41f5-ba26-38b98a246edb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: .version_select at 0x7fa82442c4c0>, body: {"keypair": {"name": "tempest-keypair-1107906281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCOOsKCDoZtbR4mpBSSmA84HjAUZqbTqaw7oQBI4srMHS0mnOuH0kBRke2kae92v4owKJcwR89Mw5N3rn8DuA6D1oOgpeber6+/g2PzGQ0zYxQxqjpZgdnzx+NtMm97cA=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:24.961172 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-0ab64d05-3412-41f5-ba26-38b98a246edb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:24.966740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-0ab64d05-3412-41f5-ba26-38b98a246edb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for user 2ff9f53decbc44ce9166f6c841e8ea02 and project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:25.122095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0ab64d05-3412-41f5-ba26-38b98a246edb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.502722 Jun 15 00:40:25.122835 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 15/26] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jun 15 00:40:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 00:40:25.371436 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:25.372818 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:25.383755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:25.384857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:25.402617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:25.403855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:25.658213 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:25.670112 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-89bd89d3-8c56-4f14-bf04-d6c2168f483f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1272 microversion: 2.1 time: 0.302801 Jun 15 00:40:25.671025 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 12/27] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:25 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:26.355419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:26.686521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-657634095", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:26.693588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:26.694806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:26.711320 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:26.723468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:26.724831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:26.725495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:26.858125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] validate_networks() for [('bf2c6e3f-ec68-43e2-b22d-b041a66933c5', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:40:28.414178 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:28.450155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-39b2567f-1f15-48ff-831a-e39e21956a73 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 1.761213 Jun 15 00:40:28.452234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 13/28] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:26 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:28.491523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ea1c70e9-50c1-4c25-905d-b80d2978031a tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa82557b160>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:28.650059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:28.686000 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ea1c70e9-50c1-4c25-905d-b80d2978031a tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3105e836-e13f-444d-9fbc-9a15746ac4e9" status: 200 len: 351 microversion: 2.1 time: 0.231257 Jun 15 00:40:28.686907 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 14/29] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:28 2022] GET /compute/v2.1/os-volumes/3105e836-e13f-444d-9fbc-9a15746ac4e9 => generated 351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:29.409034 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:40:29.409658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:40:29.410145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:40:29.411126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:40:29.411557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:40:29.465324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:29.468335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:29.468869 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:29.469161 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:29.470600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:29.472730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:29.481012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:29.481488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:29.488769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:29.489327 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:29.502828 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:29.518954 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for user 4989693e66c44d6a8e5f8543f1b9c516 and project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:29.538802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:40:29.542759 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:40:29.728815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8ee62583-2806-48d1-8a7a-830957d8a3b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.378181 Jun 15 00:40:29.732131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 16/30] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:40:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:40:29.778359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-be798b2a-b8bd-4044-a17b-96e44154dd9e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:29.790211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-be798b2a-b8bd-4044-a17b-96e44154dd9e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:29.992025 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-be798b2a-b8bd-4044-a17b-96e44154dd9e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:30.003574 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-be798b2a-b8bd-4044-a17b-96e44154dd9e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1221 microversion: 2.1 time: 0.264278 Jun 15 00:40:30.005760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 17/31] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:29 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1221 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:30.114047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:30.125853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ab581c08-a046-4f38-8f7d-f6664fc7e528 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.660827 Jun 15 00:40:30.132653 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:29 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:30.339773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-399492906", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:30.536750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] validate_networks() for [('bf2c6e3f-ec68-43e2-b22d-b041a66933c5', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:40:31.146037 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:31.147529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:31.156724 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:31.158639 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:31.163191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:31.163922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:31.974116 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:31.986725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-601df502-284f-4b3a-bb17-482139bde10b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.842985 Jun 15 00:40:31.988076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 16/33] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:31 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:32.010977 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ea5f595c-6658-4b54-9402-41f19c93070c tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa825511280>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:32.157872 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ea5f595c-6658-4b54-9402-41f19c93070c tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/003b7b99-90c9-4a71-bc03-62ee749d0058" status: 200 len: 351 microversion: 2.1 time: 0.167506 Jun 15 00:40:32.165913 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 17/34] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:31 2022] GET /compute/v2.1/os-volumes/003b7b99-90c9-4a71-bc03-62ee749d0058 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:32.280771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1241347381", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f05909d-25bd-4873-b7be-db4fac7f0a83"}], "security_groups": [{"name": "tempest-securitygroup--966904066"}], "key_name": "tempest-keypair-418457759", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:34.055993 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] validate_networks() for [('2f05909d-25bd-4873-b7be-db4fac7f0a83', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:40:34.594800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:40:34.595862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:40:34.596646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:40:34.597249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:40:34.597747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:40:34.609311 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:34.609934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:34.611168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:34.613050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:34.642291 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:34.647535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for user 4989693e66c44d6a8e5f8543f1b9c516 and project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:34.678776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:40:34.681375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:40:34.944829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1e0a03b7-6408-454b-94eb-9921cc677f94 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.609056 Jun 15 00:40:34.951226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 18/35] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:40:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:40:34.968384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:34.970207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:35.004000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:35.004000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:35.004711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:35.005413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:35.431122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:35.441669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f725eaef-4fbc-4001-91ca-d0c62901c6a4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.489286 Jun 15 00:40:35.442567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 19/36] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:34 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:35.469768 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2007441221", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3ec445d-ab47-4471-b545-ed383178588a"}], "security_groups": [{"name": "tempest-securitygroup--359491102"}], "key_name": "tempest-keypair-1107906281", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:36.068251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] validate_networks() for [('d3ec445d-ab47-4471-b545-ed383178588a', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:40:36.389376 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:40:36.390760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:40:36.391430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:40:36.392034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:40:36.395520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:40:36.459220 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:36.467266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:36.470427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:36.470869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:36.532172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for project 30f2ff4320764a69bb987d567aed9201. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:36.548721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for user d9a0bbb1f50c42acb50dac254a653da4 and project 30f2ff4320764a69bb987d567aed9201. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:36.581022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:40:36.583819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:40:36.882000 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-86e92888-8161-48a5-ad88-4e575376e3a3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.607729 Jun 15 00:40:36.888722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:40:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 4615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:40:37.008897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:40:37.009318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:40:37.009835 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:40:37.010327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:40:37.011369 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:40:37.035513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.035976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.038636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.038636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.097757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:40:37.101656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d61b523b-0b4a-4ba8-8eb6-23361b56737a req-9c4677d7-4ac3-42cc-b0c8-a20ded9c64ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45955b1d-8032-4459-bc14-9ce82c8583ed", "tag": "2f299843-16dc-4cd3-a907-037883e7abea"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:37.119157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d61b523b-0b4a-4ba8-8eb6-23361b56737a req-9c4677d7-4ac3-42cc-b0c8-a20ded9c64ce service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.119157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d61b523b-0b4a-4ba8-8eb6-23361b56737a req-9c4677d7-4ac3-42cc-b0c8-a20ded9c64ce service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.119430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for user 2ff9f53decbc44ce9166f6c841e8ea02 and project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:40:37.122528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:37.133718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:40:37.136294 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:40:37.183223 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d61b523b-0b4a-4ba8-8eb6-23361b56737a req-9c4677d7-4ac3-42cc-b0c8-a20ded9c64ce service nova] Creating event network-changed:2f299843-16dc-4cd3-a907-037883e7abea for instance 45955b1d-8032-4459-bc14-9ce82c8583ed on hv-cinder-84517 Jun 15 00:40:37.183770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d61b523b-0b4a-4ba8-8eb6-23361b56737a req-9c4677d7-4ac3-42cc-b0c8-a20ded9c64ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=124682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 00:40:37.188244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.191271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.192211 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.194638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.219199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.compute.rpcapi [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 00:40:37.225594 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] Releasing lock "compute-rpcapi-router" {{(pid=124682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 00:40:37.291993 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-870dd5c5-2acf-4beb-973c-fb23c1dc0289 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401514 Jun 15 00:40:37.292608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 19/38] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:37.306509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3b4ac24f-34bc-4354-8e50-0259045605fb tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824c78d30>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:37.449452 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-965e6e8d-ea81-4684-8b33-464167ea4b58 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.004993 Jun 15 00:40:37.450338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 20/39] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jun 15 00:40:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 00:40:37.456458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:37.457383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:37.555262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.556883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.560610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.562432 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.796070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:37.806079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-be733cfa-4d4a-4f50-96a4-bea368d25771 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1273 microversion: 2.1 time: 0.354217 Jun 15 00:40:37.810032 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 21/40] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:37 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:37.823478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:37.840814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:37.889575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.891155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.892394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:37.896739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:37.964395 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3b4ac24f-34bc-4354-8e50-0259045605fb tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7a814205-4de6-455f-8dc6-f48f853f827b" status: 200 len: 350 microversion: 2.1 time: 0.670402 Jun 15 00:40:37.965795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:40:37 2022] GET /compute/v2.1/os-volumes/7a814205-4de6-455f-8dc6-f48f853f827b => generated 350 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:37.974141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-512499a8-9cd8-477d-9fa4-7c200062d8af tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:37.974876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-512499a8-9cd8-477d-9fa4-7c200062d8af tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:38.239007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-512499a8-9cd8-477d-9fa4-7c200062d8af tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:38.246531 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-512499a8-9cd8-477d-9fa4-7c200062d8af tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1237 microversion: 2.1 time: 0.279675 Jun 15 00:40:38.248968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:37 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1237 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:38.255412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:38.263449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:38.407419 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:38.422117 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:38.434032 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:38.438987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4843bb02-f2b0-467f-a65b-103d845ef508 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1282 microversion: 2.20 time: 0.186122 Jun 15 00:40:38.441745 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 22/43] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:38 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:38.455564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-355c320f-223c-4308-b28d-13fce5f9a3b3 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824c783a0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:38.666756 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:38.667799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-355c320f-223c-4308-b28d-13fce5f9a3b3 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.196989 Jun 15 00:40:38.667799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jun 15 00:40:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:38.668149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-37ddc647-22cb-4b80-a47c-09301b56c6b0 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.840477 Jun 15 00:40:38.668149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 22/45] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:37 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:38.671885 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ac3ce080-e0bb-4d22-ad36-63adf440ffbc tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824431a60>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:38.845766 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ac3ce080-e0bb-4d22-ad36-63adf440ffbc tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128396 Jun 15 00:40:38.845766 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 24/46] 10.222.0.17 () {58 vars in 1148 bytes} [Wed Jun 15 00:40:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:38.846330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:38.846330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:38.846500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9a691ba3-4b9f-489a-bd3d-1f07a5923c7d tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824441430>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:38.846593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:38.846593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:38.846593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:38.846593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:39.007113 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9a691ba3-4b9f-489a-bd3d-1f07a5923c7d tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.180860 Jun 15 00:40:39.007724 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 25/47] 10.222.0.17 () {58 vars in 1133 bytes} [Wed Jun 15 00:40:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:39.019076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8e35422e-f85f-4a44-a96d-f3d2dbf75e47 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824c780d0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.216815 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8e35422e-f85f-4a44-a96d-f3d2dbf75e47 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.196428 Jun 15 00:40:39.221668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1166 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:39.228439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-25dabc71-fddb-4317-b492-cbb29b267f98 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa824441790>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.399533 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:39.422549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2862ca71-b1c5-426c-80b8-d0fa973f387f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1281 microversion: 2.1 time: 0.599255 Jun 15 00:40:39.423897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 23/49] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:38 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1281 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:39.430298 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-58dffe77-c331-4905-8937-f69ae5237c87 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.434141 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-58dffe77-c331-4905-8937-f69ae5237c87 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:39.518847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-25dabc71-fddb-4317-b492-cbb29b267f98 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.295646 Jun 15 00:40:39.519665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 27/50] 10.222.0.17 () {58 vars in 1169 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:39.542925 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.543678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:39.547959 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:39.570442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-58dffe77-c331-4905-8937-f69ae5237c87 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:39.578990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-58dffe77-c331-4905-8937-f69ae5237c87 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1237 microversion: 2.1 time: 0.153760 Jun 15 00:40:39.579881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:39.585130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-942a624b-719f-470a-8469-3948112dfb90 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa8243e1af0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.654990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:39.671609 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:39.681270 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:39.682806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f6467fed-1ad1-45da-90a8-6f223aee343b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1282 microversion: 2.20 time: 0.154353 Jun 15 00:40:39.683994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 28/52] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:39.693137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:39.696914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:39.714297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:39.715050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:39.716220 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:39.717583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:39.793980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-942a624b-719f-470a-8469-3948112dfb90 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.212896 Jun 15 00:40:39.802615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 25/53] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:39.808545 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cfa47589-8da8-41b8-9d9f-a553a4eb139b tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa8243e9280>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:40.014861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cfa47589-8da8-41b8-9d9f-a553a4eb139b tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210681 Jun 15 00:40:40.015822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 26/54] 10.222.0.17 () {58 vars in 1187 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:40.028372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5e014a09-c7de-47c9-9768-a4b20d83b5a6 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] Calling method '.version_select at 0x7fa8243e9700>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:40.083578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.094521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-32c043ea-1e7e-4117-9198-56b40f6cc113 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.409138 Jun 15 00:40:40.104896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 29/55] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:39 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:40.156139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5e014a09-c7de-47c9-9768-a4b20d83b5a6 tempest-VolumesTestJSON-686870983 tempest-VolumesTestJSON-686870983-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.132002 Jun 15 00:40:40.158559 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 27/56] 10.222.0.17 () {58 vars in 1154 bytes} [Wed Jun 15 00:40:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:40.442416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:40.444623 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:40.465045 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.465739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.478932 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.479698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.604695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:40.604695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:40.613977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.614433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.615224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.615659 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.681542 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=41 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:40.685041 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.705909 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c655066f-d7b5-43a1-9f4c-bcf8412e485f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1279 microversion: 2.1 time: 0.267294 Jun 15 00:40:40.709207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 30/57] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:40 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1279 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:40.721762 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:40.723535 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:40.762207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.762815 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.765928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:40.767861 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:40.809743 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.822591 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-be0d97ab-57fd-44d1-afad-400b7eeb5db2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1233 microversion: 2.1 time: 0.227587 Jun 15 00:40:40.824872 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 28/58] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:40 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1233 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:40.942784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.967362 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.973140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:40.978769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-51fcd363-76eb-42eb-9658-d0313e0591d3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1286 microversion: 2.20 time: 0.266612 Jun 15 00:40:40.989337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 31/59] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:40 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1286 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:41.028621 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-12eba658-a37b-45e8-988d-04f400dd656f req-5eaedae4-24c6-4829-88c1-b0ff341e44c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6969bf2-cd90-4330-8d7f-bcc914245566", "tag": "d4ebf932-461b-49a7-aac4-453557dda2ea"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:41.046733 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-12eba658-a37b-45e8-988d-04f400dd656f req-5eaedae4-24c6-4829-88c1-b0ff341e44c5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.047461 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-12eba658-a37b-45e8-988d-04f400dd656f req-5eaedae4-24c6-4829-88c1-b0ff341e44c5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.082800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-12eba658-a37b-45e8-988d-04f400dd656f req-5eaedae4-24c6-4829-88c1-b0ff341e44c5 service nova] Creating event network-changed:d4ebf932-461b-49a7-aac4-453557dda2ea for instance f6969bf2-cd90-4330-8d7f-bcc914245566 on hv-cinder-84517 Jun 15 00:40:41.083603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-12eba658-a37b-45e8-988d-04f400dd656f req-5eaedae4-24c6-4829-88c1-b0ff341e44c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 00:40:41.085375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.085989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.087500 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.088301 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.101238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.compute.rpcapi [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 00:40:41.102735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a48c17b6-5929-462e-b977-c9479460359e None None] Releasing lock "compute-rpcapi-router" {{(pid=124683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 00:40:41.116073 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:41.116767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:41.128760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.128760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.129548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.130043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.152908 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a48c17b6-5929-462e-b977-c9479460359e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325567 Jun 15 00:40:41.155276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 29/60] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:41.446565 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:41.453288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8ab8b9f1-40c4-446d-89c1-7ad187885abf tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.340955 Jun 15 00:40:41.453857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 32/61] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:41 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:41.729764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:41.730925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:41.738884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.739395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.740192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.740627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.815314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:41.824185 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9314acae-2f82-4c80-88df-541d242a5e58 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1279 microversion: 2.1 time: 0.099249 Jun 15 00:40:41.825132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 30/62] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:41 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:41.840459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:41.841271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:41.847493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.847972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.848762 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:41.849191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:41.912539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:41.920089 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-523ba281-321d-4f94-9250-c3801a89c95e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1289 microversion: 2.1 time: 0.083532 Jun 15 00:40:41.920675 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 33/63] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:41 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:41.996914 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:41.997513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:42.003478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.003927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.004701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.005132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.068353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:42.076429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:42.078766 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:42.079894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-35373a75-0919-49f9-9973-75cf4b8d1726 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1278 microversion: 2.20 time: 0.086903 Jun 15 00:40:42.080651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 31/64] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:41 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:42.477062 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:42.477666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:42.484855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.485297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.486568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.487011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.728562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:42.736670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9757e4ad-6249-4ccc-913d-5243febe9356 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.270217 Jun 15 00:40:42.737237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:42 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:42.842042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:42.842686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:42.850117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.850820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.851568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.852310 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.938268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:42.938881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:42.945389 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.946347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:42.947122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:42.947619 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.029346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.032721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.037118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ffcfe071-946a-413d-b5e7-b5001c4ed5b2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1297 microversion: 2.1 time: 0.103492 Jun 15 00:40:43.037708 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:42 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:43.040994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3cb952e3-941c-413c-8f0a-d52744c0c661 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.202968 Jun 15 00:40:43.041564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 32/67] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:42 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:43.101944 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:43.103629 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:43.109826 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:43.110312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.111105 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:43.111482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.173374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.182451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.184346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.185586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3ae84c78-eba3-4599-ada2-63da84d09914 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1334 microversion: 2.20 time: 0.087389 Jun 15 00:40:43.196865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 36/68] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:43 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:43.401427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5d2668b1-cd78-4b45-b056-7fe1db3fb60d req-aa1d866b-6598-44c2-b022-6e4d1fcfa9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4981f4e2-08fe-49bd-a96a-b53e858e6fa3", "tag": "b05877eb-6abf-4037-85ad-714570af0aad"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:43.419937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5d2668b1-cd78-4b45-b056-7fe1db3fb60d req-aa1d866b-6598-44c2-b022-6e4d1fcfa9f7 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:43.420695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5d2668b1-cd78-4b45-b056-7fe1db3fb60d req-aa1d866b-6598-44c2-b022-6e4d1fcfa9f7 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.435493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5d2668b1-cd78-4b45-b056-7fe1db3fb60d req-aa1d866b-6598-44c2-b022-6e4d1fcfa9f7 service nova] Creating event network-changed:b05877eb-6abf-4037-85ad-714570af0aad for instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 on hv-cinder-84517 Jun 15 00:40:43.440729 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5d2668b1-cd78-4b45-b056-7fe1db3fb60d req-aa1d866b-6598-44c2-b022-6e4d1fcfa9f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055303 Jun 15 00:40:43.441510 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 33/69] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:43.753383 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:43.753981 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:43.759828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:43.760292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.761287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:43.761706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:43.780188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:43.950407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:43.962730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fb046c75-f2c6-4273-a957-e09f888b5346 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.213105 Jun 15 00:40:43.964086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 37/70] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:43 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:44.059678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:44.067544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:44.068066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:44.068066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:44.079513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.079968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.080745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.081179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.085540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.085995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.086765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.087194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.249919 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:44.258506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6798fec2-5e44-40a1-bccf-23a42e9270c5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1307 microversion: 2.1 time: 0.206794 Jun 15 00:40:44.268906 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 34/71] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:44 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:44.274650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:44.275256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:44.283121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.300644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.302463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.303191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.376192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:44.383938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-50e0ae98-286e-4acb-bcf2-ed411ecda8de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.328758 Jun 15 00:40:44.384552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 38/72] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:44 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:44.397169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:44.405078 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:44.407155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:44.408308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-961b336b-4e8b-49ff-8eff-a057a1ac8fcd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1342 microversion: 2.20 time: 0.137831 Jun 15 00:40:44.408852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 35/73] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:44 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:44.980034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:44.981226 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:44.988137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.988443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:44.989222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:44.989671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.151077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.158833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7e7d9827-92cf-4efb-8adc-47f417cfcc77 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.182584 Jun 15 00:40:45.168748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:44 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:45.276763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:45.289041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:45.289041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.289041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.289041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.289510 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.401673 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:45.402725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:45.411750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.413408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.414391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.414855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.442158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.450447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0051b8b0-4235-4a49-b58b-ce3358672a86 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.177321 Jun 15 00:40:45.451081 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 36/75] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:45 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:45.456020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:45.456587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:45.463321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.463774 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.464722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:45.465312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:45.577183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.589655 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.591162 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.592487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ee6df3e1-acf2-443b-9ed8-16c90c6c9ab5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1342 microversion: 2.20 time: 0.140483 Jun 15 00:40:45.593877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 37/76] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:45 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1342 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:45.662286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:45.670718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c8661f0e-9f33-4fb5-9a0f-92292ff88641 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.272945 Jun 15 00:40:45.681051 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 40/77] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:45 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:46.175759 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:46.176624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:46.183063 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.183720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.184741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.185340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.471643 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:46.472638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:46.483748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.483748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.483748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.484329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.511520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:46.534625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7c363aa8-0dcb-49ab-a91c-7b5f55d2a66e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.360284 Jun 15 00:40:46.544868 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 38/78] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:46 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:46.611998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:46.612819 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:46.627170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.627970 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.629600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.630190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.791262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:46.806709 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:46.825392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:46.825392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0ea986af-3768-47f5-a1d2-0f5ff86729f3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1340 microversion: 2.20 time: 0.206000 Jun 15 00:40:46.825392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 39/79] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:46 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:46.825392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:46.825683 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:46.828026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.828546 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:46.829451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:46.829949 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:47.118323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:47.136653 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a14291e-722f-4131-9f01-6ab59a6b391b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.669129 Jun 15 00:40:47.137828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 41/80] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:46 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:47.206031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:47.214272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-feddcef6-7cc6-4aab-9ffd-3ec19491579b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.397936 Jun 15 00:40:47.214992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 40/81] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:46 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:47.527307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-656ff157-2c27-4a81-bbd3-04bbcdc9eee2 req-3bb01bcd-97c9-4d9e-822a-be270348ce2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902f043a-d22e-41d1-b8f7-166e9d9080ba", "tag": "328cf711-88b8-4cb7-8fdb-8f6cf8d10c56"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:47.527307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:47.537892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-656ff157-2c27-4a81-bbd3-04bbcdc9eee2 req-3bb01bcd-97c9-4d9e-822a-be270348ce2d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:47.538342 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-656ff157-2c27-4a81-bbd3-04bbcdc9eee2 req-3bb01bcd-97c9-4d9e-822a-be270348ce2d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:47.552619 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:47.553371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:47.563751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:47.564130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:47.566110 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-656ff157-2c27-4a81-bbd3-04bbcdc9eee2 req-3bb01bcd-97c9-4d9e-822a-be270348ce2d service nova] Creating event network-changed:328cf711-88b8-4cb7-8fdb-8f6cf8d10c56 for instance 902f043a-d22e-41d1-b8f7-166e9d9080ba on hv-cinder-84517 Jun 15 00:40:47.567397 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:47.567798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:47.580567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-656ff157-2c27-4a81-bbd3-04bbcdc9eee2 req-3bb01bcd-97c9-4d9e-822a-be270348ce2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061202 Jun 15 00:40:47.583184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 42/82] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:40:47.775735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:47.785170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a03f0c52-56b2-4afb-b2c7-5505569e062b tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.236718 Jun 15 00:40:47.795838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:47 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:47.833807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:47.836618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:47.841428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:47.841874 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:47.842780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:47.843770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.157702 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:48.159035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:48.175313 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.177411 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.178235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.178637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.184968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:48.201306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:48.203796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:48.209490 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-13bc836c-a8bb-4ed6-85d6-43471db55a38 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.379741 Jun 15 00:40:48.216178 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 43/84] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:47 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:48.231031 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:48.232007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:48.245483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.246159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.247549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.252668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.616656 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:48.628973 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d08b3997-d631-4779-b4ef-b1498cf6f2b5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.479108 Jun 15 00:40:48.629861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 42/85] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:48 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:48.800195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-0b6d5550-ef9a-4795-a9f5-6fc4cbb52f84 req-c55b983c-ff33-47d7-a824-b6be99eefdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45955b1d-8032-4459-bc14-9ce82c8583ed", "name": "network-vif-plugged", "status": "completed", "tag": "2f299843-16dc-4cd3-a907-037883e7abea"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:48.807703 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:48.816132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5c024627-f3f4-4fe2-a46a-fce395ef303f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.588193 Jun 15 00:40:48.817178 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:48 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:48.823828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:48.824833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:48.831870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b6d5550-ef9a-4795-a9f5-6fc4cbb52f84 req-c55b983c-ff33-47d7-a824-b6be99eefdd7 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.832354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b6d5550-ef9a-4795-a9f5-6fc4cbb52f84 req-c55b983c-ff33-47d7-a824-b6be99eefdd7 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.833338 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.833914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.834794 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:48.835479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:48.866697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-0b6d5550-ef9a-4795-a9f5-6fc4cbb52f84 req-c55b983c-ff33-47d7-a824-b6be99eefdd7 service nova] Creating event network-vif-plugged:2f299843-16dc-4cd3-a907-037883e7abea for instance 45955b1d-8032-4459-bc14-9ce82c8583ed on hv-cinder-84517 Jun 15 00:40:48.898247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-0b6d5550-ef9a-4795-a9f5-6fc4cbb52f84 req-c55b983c-ff33-47d7-a824-b6be99eefdd7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173841 Jun 15 00:40:48.899767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 43/87] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:49.237387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:49.242897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:49.246474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.246572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.247384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.247870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.248687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:49.262958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-932b76f5-1198-4449-be04-e8568e9f56fb tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.442559 Jun 15 00:40:49.264329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 45/88] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:48 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:49.570033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:49.580220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=40 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:49.584516 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:49.587219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:49.588437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-96b6abcb-ccde-4ab5-a2bc-52d5778bb8d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.360168 Jun 15 00:40:49.602349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 44/89] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:49 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:40:49.609298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-134203af-f1fe-4f67-b7b9-9925348f82d9 req-9877c02c-b90c-4a28-935d-e841c0aff0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:49.619352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-134203af-f1fe-4f67-b7b9-9925348f82d9 req-9877c02c-b90c-4a28-935d-e841c0aff0f0 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.622071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-134203af-f1fe-4f67-b7b9-9925348f82d9 req-9877c02c-b90c-4a28-935d-e841c0aff0f0 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.634833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-134203af-f1fe-4f67-b7b9-9925348f82d9 req-9877c02c-b90c-4a28-935d-e841c0aff0f0 service nova] Creating event network-changed:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:40:49.641301 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-134203af-f1fe-4f67-b7b9-9925348f82d9 req-9877c02c-b90c-4a28-935d-e841c0aff0f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039140 Jun 15 00:40:49.642290 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 46/90] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:49.646988 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:49.648223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:49.655512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.656713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.664214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.664991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.830738 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=12 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:49.835414 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:49.836487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:49.845040 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.849427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:49.849427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:49.849427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.031605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.040780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dea88df4-03a5-4a4f-bd89-b0e86cdbbd90 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.397187 Jun 15 00:40:50.052606 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 45/91] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:49 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:50.098004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.104317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-81c4c2b2-1c23-4057-be31-aac18f2f29ed tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.274423 Jun 15 00:40:50.105504 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 47/92] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:49 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:50.281458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:50.282055 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:50.293858 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:50.294297 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.295225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:50.295653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.491187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.493372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:50.500515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fdf56303-2ee6-4749-8ed6-47cf8f622ae1 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.222874 Jun 15 00:40:50.511232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 46/93] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:50 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:50.608988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:50.609666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:50.617309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:50.617990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.618867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:50.619482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.836244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.852914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.856613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:50.857825 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-614688a9-a30a-4ca0-b344-b45fb0dbc7c7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.253935 Jun 15 00:40:50.862535 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 48/94] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:50 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:50.932475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4a58b855-c9b7-4995-ba82-3eb237d9b888 req-efb9b291-003e-4ac4-b3cc-de900af6c515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6969bf2-cd90-4330-8d7f-bcc914245566", "name": "network-vif-plugged", "status": "completed", "tag": "d4ebf932-461b-49a7-aac4-453557dda2ea"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:50.942414 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4a58b855-c9b7-4995-ba82-3eb237d9b888 req-efb9b291-003e-4ac4-b3cc-de900af6c515 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:50.943060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4a58b855-c9b7-4995-ba82-3eb237d9b888 req-efb9b291-003e-4ac4-b3cc-de900af6c515 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:50.954998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4a58b855-c9b7-4995-ba82-3eb237d9b888 req-efb9b291-003e-4ac4-b3cc-de900af6c515 service nova] Creating event network-vif-plugged:d4ebf932-461b-49a7-aac4-453557dda2ea for instance f6969bf2-cd90-4330-8d7f-bcc914245566 on hv-cinder-84517 Jun 15 00:40:50.959966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4a58b855-c9b7-4995-ba82-3eb237d9b888 req-efb9b291-003e-4ac4-b3cc-de900af6c515 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Jun 15 00:40:50.960549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 47/95] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:40:51.069160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:51.069842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:51.077913 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.078353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.079898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.080505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.118949 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=8 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:51.123158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:51.124139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:51.135249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.136011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.136782 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.137214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.296236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:51.304338 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a1efb52c-7e4e-40b5-ad7d-d2a687ce93d9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.249087 Jun 15 00:40:51.305044 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 49/96] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:51 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:51.328833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:51.339210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a3420db4-b5f1-4bdb-ab12-7bf740f5b353 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.221117 Jun 15 00:40:51.350281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 48/97] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:51 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:51.521583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:51.522554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:51.529279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.530681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.530681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.531144 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.664454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:51.672152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-255179dd-5d32-45eb-a230-69746c752cc8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.155913 Jun 15 00:40:51.672724 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 50/98] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:51 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:51.877722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:51.878315 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:51.884866 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.885312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:51.886331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:51.886760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.049481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.058416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.059960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.061192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2415163e-765c-435f-9cc9-c01899735ddb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.188028 Jun 15 00:40:52.062994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 49/99] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:51 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:52.321833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:52.324292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:52.330955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.331395 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.332337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.333050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.362289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:52.363540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:52.383104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.383992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.388465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.389107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.519828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.528190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-856289da-897e-4dfe-bde8-6d4d4ddef074 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.210876 Jun 15 00:40:52.528954 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 51/100] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:52 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:52.572751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.581312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c26c83b7-a06a-43a8-b4b4-a88305964050 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.227318 Jun 15 00:40:52.582469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:52 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:52.688604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:52.689220 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:52.695427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.695865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.696638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:52.697059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:52.826195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:52.839582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-eed02de7-37b0-449a-bcb0-04ac14b0b39f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.152986 Jun 15 00:40:52.839582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 52/102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:52 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:53.080598 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:53.081220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:53.087326 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.087764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.088591 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.089015 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.215114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:53.223143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:53.224927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:53.227123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7f05c992-4a18-4459-9d28-c51128cffaaa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.150172 Jun 15 00:40:53.228252 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 51/103] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:53 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:53.547819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:53.549101 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:53.557599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.558087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.559034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.559630 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.599357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:53.600067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:53.606062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.606477 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.607241 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.607661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.831983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:53.833135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:53.841783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cf6ec78c-5fa7-4994-9ef6-0ddf6392b342 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.299613 Jun 15 00:40:53.846715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-25a8d034-3ceb-4548-ad65-94acae9ca7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.250907 Jun 15 00:40:53.848144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 52/104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:53 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:53.852081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 53/105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:53 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:53.858701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:53.858701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:53.871528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.872238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:53.873288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:53.873714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.004121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:54.011790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8918a7d5-24b0-477f-b8c9-b4e61432642a tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.161279 Jun 15 00:40:54.012453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 53/106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:53 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:54.246248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:54.246940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:54.253684 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.254382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.255206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.255879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.411154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:54.420114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:54.422295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:54.423591 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a4b8b632-5cb3-49f7-a691-1be5f98785c2 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.181514 Jun 15 00:40:54.424162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 54/107] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:54 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:40:54.858453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:54.859056 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:54.865733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:54.866295 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.866434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:54.867006 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.867948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.868525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.873540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.879790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.879790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:54.879790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:54.898169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:55.080247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.088544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e861b6fc-8370-4e8e-8b74-5249f4b9e218 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.233860 Jun 15 00:40:55.098000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 54/108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:54 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:55.098087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.098208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:55.098208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:55.100749 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-60345e23-f350-4af8-8553-98edd7706b92 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.239009 Jun 15 00:40:55.101325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 55/109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:54 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:55.101817 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:55.102257 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:55.103038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:55.103466 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:55.267595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.275511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9f80063c-f078-44b9-84dc-faff0991bfc3 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.185021 Jun 15 00:40:55.276504 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 55/110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:55 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:55.441886 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:55.442488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:55.448939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:55.449386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:55.450147 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:55.450573 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:55.702738 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.711295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.713014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:55.714364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e60d120b-1e9b-48fe-b425-905e930c249a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.276707 Jun 15 00:40:55.715039 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 56/111] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:55 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:56.104933 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:56.105608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:56.111834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.114917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.118162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:56.118873 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:56.126245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.126811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.129279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.129755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.130574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.131006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.390991 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.400411 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e6b0c52d-5a8a-499c-b0ab-47689b5aedfe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.285965 Jun 15 00:40:56.401058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 57/112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:56 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:56.401662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.406647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:56.407435 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:56.412965 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4f7d65a5-26e8-4b12-8ee9-f97254cf5750 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.311949 Jun 15 00:40:56.415878 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 56/113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:56 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:56.415998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.415998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.416159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.416536 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.558125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.565754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d0e2676-e72d-4dae-9059-2f219eb0c508 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.163279 Jun 15 00:40:56.566315 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 58/114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:56 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:56.740244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:56.740931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:56.749367 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.752599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.753771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:56.754351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:56.922079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.931126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.932987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:56.934137 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-87e01f48-fcbf-4ad6-b5f5-ca73e2b56bb4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.198670 Jun 15 00:40:56.934703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 57/115] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:56 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:57.222280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-a0eadbc6-cb81-4b28-bf5e-533d9233b3bc req-3dafda0c-db7c-46b7-904c-2f4c7e792b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4981f4e2-08fe-49bd-a96a-b53e858e6fa3", "name": "network-vif-plugged", "status": "completed", "tag": "b05877eb-6abf-4037-85ad-714570af0aad"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:40:57.231445 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a0eadbc6-cb81-4b28-bf5e-533d9233b3bc req-3dafda0c-db7c-46b7-904c-2f4c7e792b30 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.233735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a0eadbc6-cb81-4b28-bf5e-533d9233b3bc req-3dafda0c-db7c-46b7-904c-2f4c7e792b30 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.246083 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-a0eadbc6-cb81-4b28-bf5e-533d9233b3bc req-3dafda0c-db7c-46b7-904c-2f4c7e792b30 service nova] Creating event network-vif-plugged:b05877eb-6abf-4037-85ad-714570af0aad for instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 on hv-cinder-84517 Jun 15 00:40:57.252585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-a0eadbc6-cb81-4b28-bf5e-533d9233b3bc req-3dafda0c-db7c-46b7-904c-2f4c7e792b30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Jun 15 00:40:57.253229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 59/116] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:40:57.417086 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:57.417742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:57.432789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:57.434876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:57.437945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.438589 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.439515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.440117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.443728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.444375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.445539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.446616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.749220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:57.752194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:57.760219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-030cffb7-67a9-41da-86dc-a5e29732c486 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.346540 Jun 15 00:40:57.762313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6d66a246-5ace-4e13-a7ca-eb98c69ae5fa tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.334420 Jun 15 00:40:57.763492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 60/117] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:57 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:57.768170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:57.771733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:57.771845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 58/118] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:57 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:57.776522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.777185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.778073 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.778581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.931952 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:57.946068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-61a32f95-6b4c-45f6-86cf-3214fc5c96cc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1314 microversion: 2.1 time: 0.175045 Jun 15 00:40:57.948270 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 61/119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:57 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:57.953904 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:57.954497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:57.968329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.973150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:57.973150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:57.973150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:58.196495 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:58.206480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:58.207892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:58.209124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7de64f5d-ed42-411f-83cc-a9aeacdc767f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.259583 Jun 15 00:40:58.209677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 59/120] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:57 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:40:58.778443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:58.780953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:58.781517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:58.782070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:58.788772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:58.789540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:58.789768 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:58.790166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:58.790928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:58.791179 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:58.791346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:58.792074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:59.097182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.106701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-24328e5f-11bd-40ca-97f0-59a04a0d03d3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.329553 Jun 15 00:40:59.107414 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 60/121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:58 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:40:59.108079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.112548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:59.113299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:59.126277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-03f055b1-ccd9-4948-ad17-157fdaac9a26 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.352494 Jun 15 00:40:59.127277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 62/122] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:58 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:59.129754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:59.130353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:59.131256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:59.131851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:59.232631 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:40:59.233359 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:40:59.240386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:59.241169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:59.241939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:40:59.242371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:40:59.293911 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.305961 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ef33cbb7-938f-4a8f-b009-0776391915c5 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1502 microversion: 2.1 time: 0.196605 Jun 15 00:40:59.307244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:40:59 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:40:59.385921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.393928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.395597 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:40:59.396723 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8306e60a-9b97-42cf-8baa-a32597e7826e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.172269 Jun 15 00:40:59.407077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 63/124] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:40:59 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:00.123922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:00.124551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:00.130714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.143747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.143747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.143747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.144050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:00.144050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:00.150609 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.151057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.151940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.152426 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.325049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:00.328832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:00.333536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-52876925-138d-4e42-b3dd-73e2b51c14ce tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.213459 Jun 15 00:41:00.339865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 62/125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:00 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:00.340331 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0a088747-0076-4abf-b5ea-495996d919b3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.198225 Jun 15 00:41:00.340331 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 64/126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:00 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:00.414340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:00.414926 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:00.421047 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.421529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.422262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:00.422688 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:00.560685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:00.570174 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:00.571671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:00.572834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2ea9507-d76d-4540-acc2-bb17d57d557a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.162334 Jun 15 00:41:00.573387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 63/127] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:00 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:01.351796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:01.352431 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:01.356918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:01.359033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:01.359608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.360087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.365236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.365236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.365778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.366218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.367094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.367683 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.383723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:01.562884 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:01.566780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:01.570739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e3f5707b-db2a-4d4a-aa0f-7c27ba7d7028 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.223084 Jun 15 00:41:01.571303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 65/128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:01 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:01.574087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-73d01f58-668b-44d1-873c-86604229894e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.220999 Jun 15 00:41:01.574644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 64/129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:01 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:01.590950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:01.591542 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:01.598229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.598666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.599407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:01.599835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:01.725082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:01.733101 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:01.734671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:01.736021 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b4f44084-10d5-4b6e-b6ea-80aa6f8f29a1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.148767 Jun 15 00:41:01.736774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 66/130] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:01 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:41:02.589172 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:02.590317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:02.590538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:02.591313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:02.597240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.597501 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.597689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.598118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.598439 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.598864 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.598984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.599291 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.793355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:02.800733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:02.814121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c6e610a1-5f06-4d46-a491-8dc9e82d82ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.216823 Jun 15 00:41:02.814121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 65/131] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:02 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:02.814121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:02.814121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:02.814502 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6a205218-24f4-4de2-a3e4-39adb2221a36 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.221973 Jun 15 00:41:02.814502 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 67/132] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:02 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:02.814668 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.814668 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.814668 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:02.814893 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:02.945114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:02.952920 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:02.954399 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:02.955545 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d48dc10d-fb02-4d79-94dc-923ea07d9739 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.152429 Jun 15 00:41:02.956186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 66/133] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:02 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:03.296552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17e5c4c0-6a6a-42eb-8930-60d3ed71a51a"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:03.297916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:03.304816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:03.307533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:03.307533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:03.307533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:03.821235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:03.821927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:03.828590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:03.829037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:03.829789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:03.830220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.018980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:04.031120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7034102b-a1e1-4307-86e1-5a23bcea34eb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.213678 Jun 15 00:41:04.037342 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:03 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:04.046410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:04.049498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:04.065046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:04.065492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.068857 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:04.069294 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.231299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:04.235570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4db0dabd-d80c-4a6b-9e7b-69dbc0c3cbd7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.196552 Jun 15 00:41:04.236187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:04 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:04.242684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:04.243551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:04.246391 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:04.250468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:04.250915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.251744 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:04.252261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.395403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:04.404281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:04.405864 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:04.406968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a787841b-ed92-466f-afd0-924b0dfd37f7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.169885 Jun 15 00:41:04.408133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 69/136] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:04 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:04.421465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-73e9ffe7-8593-4db5-87ae-591a81f8167e req-a417859a-13f3-43e5-813d-dc2f516a3393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f043a-d22e-41d1-b8f7-166e9d9080ba", "name": "network-vif-plugged", "status": "completed", "tag": "328cf711-88b8-4cb7-8fdb-8f6cf8d10c56"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:04.429674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-73e9ffe7-8593-4db5-87ae-591a81f8167e req-a417859a-13f3-43e5-813d-dc2f516a3393 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:04.430112 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-73e9ffe7-8593-4db5-87ae-591a81f8167e req-a417859a-13f3-43e5-813d-dc2f516a3393 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:04.441602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-73e9ffe7-8593-4db5-87ae-591a81f8167e req-a417859a-13f3-43e5-813d-dc2f516a3393 service nova] Creating event network-vif-plugged:328cf711-88b8-4cb7-8fdb-8f6cf8d10c56 for instance 902f043a-d22e-41d1-b8f7-166e9d9080ba on hv-cinder-84517 Jun 15 00:41:04.452305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-73e9ffe7-8593-4db5-87ae-591a81f8167e req-a417859a-13f3-43e5-813d-dc2f516a3393 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Jun 15 00:41:04.452305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 70/137] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:05.057599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:05.057599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:05.060264 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.060711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.061492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.061916 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.203147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:05.210619 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4a737beb-41df-4be9-b6b8-825daa2fa8a1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.165980 Jun 15 00:41:05.211191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:05 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:05.252707 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:05.253446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:05.259360 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.259804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.260850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.261280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.405885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:05.415380 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6da4ddd8-49d7-43e0-b064-d14f15693008 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1321 microversion: 2.1 time: 0.166952 Jun 15 00:41:05.416144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:05 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:05.427514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:05.432012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:05.434530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.434979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.435734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:05.436210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:05.537645 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d83e2bd-6d13-409d-8478-22eb81a8b736 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "POST /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.249830 Jun 15 00:41:05.539214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 68/140] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:41:03 2022] POST /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed/os-volume_attachments => generated 194 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:05.703553 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:05.728225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:05.728225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:05.728225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d9e31d5b-25e8-479f-8ffe-2fd34fd3541a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.305006 Jun 15 00:41:05.732463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 73/141] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:05 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:06.228141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:06.229084 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:06.236185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.238687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.238687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.238687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.373844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:06.381326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e2eadc86-b66a-4cab-93cb-63978d88ad80 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1362 microversion: 2.1 time: 0.158262 Jun 15 00:41:06.385895 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 69/142] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:06 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:06.434649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:06.435132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:06.442280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.442865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.444041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.445011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.460486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-48653785-9833-4dd1-8696-7eeaee555ea1 req-4d794cf2-d962-459a-9c14-fbdb4dbdebbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "name": "network-vif-plugged", "status": "completed", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:06.469024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-48653785-9833-4dd1-8696-7eeaee555ea1 req-4d794cf2-d962-459a-9c14-fbdb4dbdebbd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.469461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-48653785-9833-4dd1-8696-7eeaee555ea1 req-4d794cf2-d962-459a-9c14-fbdb4dbdebbd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.481092 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-48653785-9833-4dd1-8696-7eeaee555ea1 req-4d794cf2-d962-459a-9c14-fbdb4dbdebbd service nova] Creating event network-vif-plugged:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:41:06.486942 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-48653785-9833-4dd1-8696-7eeaee555ea1 req-4d794cf2-d962-459a-9c14-fbdb4dbdebbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030039 Jun 15 00:41:06.487971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 70/143] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:06.589679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:06.597960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0d928c39-22b7-4514-80a8-823eb1c85b9c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1516 microversion: 2.1 time: 0.169493 Jun 15 00:41:06.598656 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:06 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:06.616362 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:06.617513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:06.623813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.624224 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.625115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.625550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.648279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lazy-loading 'flavor' on Instance uuid 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:41:06.700215 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:06.751837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:06.752567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:06.761965 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.762810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.763767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:06.764489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:06.950046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:06.960566 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:06.962165 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:06.963265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-45325f5e-8458-4f44-b5b7-a37873bc1e99 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.221566 Jun 15 00:41:06.964008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 75/145] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:06 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:07.060350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-54790414-8f8d-4de3-abac-851103eee8fc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3/action" status: 200 len: 32 microversion: 2.1 time: 0.448418 Jun 15 00:41:07.060953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 71/146] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:41:06 2022] POST /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3/action => generated 32 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 00:41:07.073007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:07.073616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:07.080653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.081100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.081915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.082378 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.215211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:07.223826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-826b63b4-7ceb-4cf1-afb8-70d316084a9d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.157122 Jun 15 00:41:07.224119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 76/147] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:07 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:07.399732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:07.400568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:07.413358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.413358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.413358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.413358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.593525 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:07.601265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-19671872-cba8-4c48-8a6f-a39e256acfb7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1549 microversion: 2.1 time: 0.206420 Jun 15 00:41:07.601864 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 72/148] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:07 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1549 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:07.619037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:07.624170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:07.626010 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.626538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.627360 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.627877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.747209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-54f9d649-424d-466b-bb7d-89e3aa08429e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131172 Jun 15 00:41:07.748114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 77/149] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:41:07 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:07.981193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:07.981879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:07.988229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.988670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:07.989416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:07.989838 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:08.241451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:08.242270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:08.250544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:08.251104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:08.252193 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:08.253092 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:08.264964 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:08.275137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:08.281520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:08.283254 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-326ab44f-0e01-4170-a12e-76c88cd649b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.305994 Jun 15 00:41:08.285432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 73/150] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:07 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:08.591645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:08.599668 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0e8ff612-2f59-40d2-ba2e-d202c2b7e894 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.363644 Jun 15 00:41:08.600992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 78/151] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:08 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:09.302807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:09.303412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:09.322410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:09.322410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:09.322410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:09.322410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:09.473701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-829978c2-22f3-4cd5-a552-067eef90b18f req-f23bcaa7-bd4c-4123-b0b9-e6759742962b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902f043a-d22e-41d1-b8f7-166e9d9080ba", "tag": "328cf711-88b8-4cb7-8fdb-8f6cf8d10c56"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:09.489242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-829978c2-22f3-4cd5-a552-067eef90b18f req-f23bcaa7-bd4c-4123-b0b9-e6759742962b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:09.489852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-829978c2-22f3-4cd5-a552-067eef90b18f req-f23bcaa7-bd4c-4123-b0b9-e6759742962b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:09.507071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-829978c2-22f3-4cd5-a552-067eef90b18f req-f23bcaa7-bd4c-4123-b0b9-e6759742962b service nova] Creating event network-changed:328cf711-88b8-4cb7-8fdb-8f6cf8d10c56 for instance 902f043a-d22e-41d1-b8f7-166e9d9080ba on hv-cinder-84517 Jun 15 00:41:09.512454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-829978c2-22f3-4cd5-a552-067eef90b18f req-f23bcaa7-bd4c-4123-b0b9-e6759742962b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042348 Jun 15 00:41:09.513392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 79/152] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:41:09.546427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:09.557509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:09.560349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:09.566015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-348e599b-ba1b-41df-b84e-bf7eee653549 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1407 microversion: 2.20 time: 0.263212 Jun 15 00:41:09.566015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 74/153] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:09 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:09.618150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:09.618943 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:09.625824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:09.626496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:09.627244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:09.627765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:09.996922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:10.006669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-62d7207e-1832-45f5-9c6c-f503245dc8a7 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.392626 Jun 15 00:41:10.007798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 80/154] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:09 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:10.583443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:10.585599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:10.599122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:10.599663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:10.600778 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:10.601325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:10.743012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:10.751875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:10.753418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:10.754559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b8cae5a2-b59b-4467-976a-21eb7fcc6022 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1600 microversion: 2.20 time: 0.175487 Jun 15 00:41:10.755377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 75/155] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:41:10 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:41:10.773430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:10.773905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:10.780605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:10.781148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:10.781890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:10.782313 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:10.867223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f22fb01f-d91b-47b5-9a17-d67b3f060524 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092127 Jun 15 00:41:10.867223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 81/156] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jun 15 00:41:10 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:41:11.024583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:11.025205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:11.031115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:11.031562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:11.032341 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:11.032778 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:11.169521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:11.177193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c45576ac-1dc2-40b5-adaa-79ae6276e87a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.156561 Jun 15 00:41:11.179958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 76/157] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:11 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:12.194985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:12.196239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:12.202821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:12.203354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:12.204199 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:12.204621 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:12.277477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-0e826e72-fb78-4b8c-b9f1-cb08f4476690 req-0537effc-7514-4a79-869d-cb31be5b6bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:12.282238 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:12.302229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0e826e72-fb78-4b8c-b9f1-cb08f4476690 req-0537effc-7514-4a79-869d-cb31be5b6bbd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:12.302849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0e826e72-fb78-4b8c-b9f1-cb08f4476690 req-0537effc-7514-4a79-869d-cb31be5b6bbd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:12.319639 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-0e826e72-fb78-4b8c-b9f1-cb08f4476690 req-0537effc-7514-4a79-869d-cb31be5b6bbd service nova] Creating event network-changed:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:41:12.328351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-0e826e72-fb78-4b8c-b9f1-cb08f4476690 req-0537effc-7514-4a79-869d-cb31be5b6bbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053804 Jun 15 00:41:12.332479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 77/158] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:41:12.391004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:12.393316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:12.400365 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-87e9f2d6-3097-4564-9df4-e898b098e50a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.209305 Jun 15 00:41:12.401451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 82/159] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:12 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:13.428683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:13.430012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:13.437939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:13.438382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:13.439131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:13.439551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:13.584347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:13.595761 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-361676d1-da7b-43b5-b74b-c4105a1c1d8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.172143 Jun 15 00:41:13.596515 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 78/160] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:13 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:14.613353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:14.613954 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:14.620877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:14.621313 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:14.622363 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:14.622899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:14.788605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:14.796351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6dda5e32-8878-43ed-b887-db05241ea9ea tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.187178 Jun 15 00:41:14.796915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 83/161] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:14 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:15.813386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:15.813986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:15.820498 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:15.821016 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:15.821846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:15.822334 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:15.969393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:15.976835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c919ffd4-0c2b-410a-a003-e94a5a9c0f56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.167621 Jun 15 00:41:15.977396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 79/162] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:15 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:16.639804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:16.640874 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:16.646966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:16.647624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:16.648414 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:16.648938 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:16.677211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:41:16.993585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:16.994206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:17.000476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:17.000918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:17.005718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:17.005718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:17.058509 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-deb274f3-7e68-4281-9b2c-3e40ba23f14f tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 204 len: 0 microversion: 2.1 time: 0.422550 Jun 15 00:41:17.060013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 84/163] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:41:16 2022] DELETE /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:41:17.072896 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:17.074699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:17.081636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:17.082189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:17.083055 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:17.083557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:17.172914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:17.181989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7736ec0e-ab2e-46a6-ae23-e5b0ed5b8acd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.192036 Jun 15 00:41:17.184024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 80/164] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:16 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:17.265982 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:17.281485 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0009a9b4-d28f-454e-af4b-dac83d51cdf7 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1554 microversion: 2.1 time: 0.208795 Jun 15 00:41:17.284204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 85/165] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:17 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:18.200111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:18.200664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:18.207797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:18.208188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:18.209412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:18.209849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:18.294371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:18.295227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:18.306176 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:18.306668 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:18.307449 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:18.312000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:18.372368 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:18.380521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1dc08849-1164-4f99-a9f0-1ca0764b52ee tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.184546 Jun 15 00:41:18.381652 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 81/166] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:18 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:18.491566 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:18.501541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6a567dc3-7ac5-4a5c-a8ca-acd5e56fa07e tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1554 microversion: 2.1 time: 0.212724 Jun 15 00:41:18.502307 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 86/167] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:18 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:19.401909 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:19.401909 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:19.412344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:19.412787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:19.413701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:19.414131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:19.519608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:19.520338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:19.526626 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:19.527235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:19.528228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:19.528651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:19.582065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:19.588696 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-00b42e69-b8d6-47e5-857f-20b02b9e7cfc tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.193920 Jun 15 00:41:19.589269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 82/168] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:19 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:19.682287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:19.703074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f7058064-adf4-4511-892b-2c45ea572ae8 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1554 microversion: 2.1 time: 0.177660 Jun 15 00:41:19.703074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 87/169] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:19 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:20.608120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:20.609347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-777464369", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:20.609862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:20.621018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:20.624209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:20.624209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:20.627228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:20.748458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] validate_networks() for None {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:41:20.955333 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:20.969131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d50fdb34-5d0a-4676-867f-c5d958d9ebbd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.366269 Jun 15 00:41:20.978433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 88/170] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:20 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:20.978433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:20.978433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:20.990378 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:20.990820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:20.996197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:20.996197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:21.074088 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:21.083698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d64b79fe-1a5c-4e23-8ed6-c9d2c56c51af tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1345 microversion: 2.1 time: 0.112816 Jun 15 00:41:21.084560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 89/171] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:20 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:21.088688 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-1a01f6c5-c649-44f3-b9db-34630e254a3c req-72bb1956-bb9e-4a97-a8c6-35931b712fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45955b1d-8032-4459-bc14-9ce82c8583ed", "name": "network-vif-deleted", "tag": "2f299843-16dc-4cd3-a907-037883e7abea"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:21.099098 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1a01f6c5-c649-44f3-b9db-34630e254a3c req-72bb1956-bb9e-4a97-a8c6-35931b712fc5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:21.099516 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-1a01f6c5-c649-44f3-b9db-34630e254a3c req-72bb1956-bb9e-4a97-a8c6-35931b712fc5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:21.111470 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-1a01f6c5-c649-44f3-b9db-34630e254a3c req-72bb1956-bb9e-4a97-a8c6-35931b712fc5 service nova] Creating event network-vif-deleted:2f299843-16dc-4cd3-a907-037883e7abea for instance 45955b1d-8032-4459-bc14-9ce82c8583ed on hv-cinder-84517 Jun 15 00:41:21.114103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:41:21.114529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:41:21.116594 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:41:21.116594 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:41:21.116594 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:41:21.116910 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-1a01f6c5-c649-44f3-b9db-34630e254a3c req-72bb1956-bb9e-4a97-a8c6-35931b712fc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Jun 15 00:41:21.117130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 90/172] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:21.125702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:21.126143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:21.126929 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:21.127358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:21.144140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Getting quotas for project c44c4f14b5f04c2aa6585ac5d3b2d2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:41:21.148151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Getting quotas for user 94db038cce364dd487ee170a4e1c8ad0 and project c44c4f14b5f04c2aa6585ac5d3b2d2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:41:21.159328 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:41:21.161624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:41:21.298327 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cb34cd20-7b52-4acf-b7eb-83d32d0fe293 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700133 Jun 15 00:41:21.298988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 83/173] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:41:21.309596 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-665989c6-9037-4420-965b-73287d489cfa tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:21.310986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-665989c6-9037-4420-965b-73287d489cfa tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:21.375742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-665989c6-9037-4420-965b-73287d489cfa tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:21.382944 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-665989c6-9037-4420-965b-73287d489cfa tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1214 microversion: 2.1 time: 0.077432 Jun 15 00:41:21.383776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:21 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:21.986963 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:21.987713 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:21.995365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:21.995811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:21.996795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:21.997168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.101089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:22.102562 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:22.110585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:22.110810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.112689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:22.113126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.133191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:22.142187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8879b055-42f8-44c8-9421-0288d9c0a179 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.159873 Jun 15 00:41:22.142999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 84/175] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:21 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:22.150491 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:22.151026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.151502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lazy-loading 'fault' on Instance uuid 45955b1d-8032-4459-bc14-9ce82c8583ed {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:41:22.195323 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acef8b517cc41e684dfa9b3a765edb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c72ff79bb364f0d9bc9d9397abd5318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:22.203951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-10cc775b-5a59-4010-aab6-be1493907834 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 200 len: 1350 microversion: 2.1 time: 0.106646 Jun 15 00:41:22.204524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 92/176] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:22 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:22.400065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:22.400672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:22.406641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:22.407086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.407834 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:22.408296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:22.485012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:22.500052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3bf6fcab-f5d9-4a3b-a023-7f319b909625 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1218 microversion: 2.1 time: 0.103702 Jun 15 00:41:22.500693 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:22 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:23.164285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:23.165465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:23.172612 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.173100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.176431 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.176431 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.222481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:23.223277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:23.230999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.232514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.233668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.234294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.290697 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] HTTP exception thrown: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Request method failure captured: Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed HTTP/1.1 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSpt1Yu6TUlmspmkhX-Nbj05NJ3yg75Kye8cMwFPNI20GI66uxZeH6hmzBx0ScegtYpJQhsrMUPNjRspUvP3AdZN20wBe9_ibqdDzEzuFhduzfrJd1qaE-J5_m34QO1FHyJe8lHxAtg_2hkRUiFHTxXEQxqGpVpe1NfT5ysXOTVn0YU Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:41:23.296783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7c72ff79bb364f0d9bc9d9397abd5318", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7c72ff79bb364f0d9bc9d9397abd5318"}]}] Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4acef8b517cc41e684dfa9b3a765edb8 Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.302717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '45955b1d-8032-4459-bc14-9ce82c8583ed'} Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:41:23.303509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.304892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.306139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Returning 404 to user: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:41:23.306139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d56a3df-75b2-45fd-abaf-b3960c1abad4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 404 len: 111 microversion: 2.1 time: 0.080596 Jun 15 00:41:23.306139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 86/178] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:23 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:41:23.346915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:23.354666 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8c27b683-13de-4ab3-9e7d-302624a8c267 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.194444 Jun 15 00:41:23.355228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:23 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:23.430775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:23.431760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:23.438144 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.438820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.439768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.440374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.455406 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] HTTP exception thrown: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Request method failure captured: Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed/os-volume_attachments HTTP/1.1 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSpt1Yu6TUlmspmkhX-Nbj05NJ3yg75Kye8cMwFPNI20GI66uxZeH6hmzBx0ScegtYpJQhsrMUPNjRspUvP3AdZN20wBe9_ibqdDzEzuFhduzfrJd1qaE-J5_m34QO1FHyJe8lHxAtg_2hkRUiFHTxXEQxqGpVpe1NfT5ysXOTVn0YU Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:41:23.457467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7c72ff79bb364f0d9bc9d9397abd5318", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7c72ff79bb364f0d9bc9d9397abd5318"}]}] Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4acef8b517cc41e684dfa9b3a765edb8 Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.458846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'server_id': '45955b1d-8032-4459-bc14-9ce82c8583ed'} Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:41:23.459735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:23.461061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:23.462986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Returning 404 to user: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:41:23.464007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-64465a86-c84a-49be-b4e1-91b9354421dc tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037397 Jun 15 00:41:23.464556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 87/180] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:41:23 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:23.518150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:23.518675 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:23.524972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.525640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.526407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:23.526828 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:23.617146 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:23.625256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-93511189-3ebe-4910-af6f-4c691acdd675 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1266 microversion: 2.1 time: 0.111741 Jun 15 00:41:23.628145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 94/181] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:23 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:24.372130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:24.373374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:24.379848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.380366 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.381151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.381577 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.526732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:24.535062 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef11e0ce-7e22-46cb-8fbf-0b3f82092c5c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.166787 Jun 15 00:41:24.536918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 88/182] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:24 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:24.642328 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:24.644001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:24.651786 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.652348 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.653154 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.654198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.730883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:24.745991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b11d1504-1174-41c6-a145-097329816ba3 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1272 microversion: 2.1 time: 0.107339 Jun 15 00:41:24.755571 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 95/183] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:24 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:24.937867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:24.939262 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:24.951773 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.952447 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.953098 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:24.955558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:24.988877 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] HTTP exception thrown: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Request method failure captured: Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed HTTP/1.1 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSpt1Yu6TUlmspmkhX-Nbj05NJ3yg75Kye8cMwFPNI20GI66uxZeH6hmzBx0ScegtYpJQhsrMUPNjRspUvP3AdZN20wBe9_ibqdDzEzuFhduzfrJd1qaE-J5_m34QO1FHyJe8lHxAtg_2hkRUiFHTxXEQxqGpVpe1NfT5ysXOTVn0YU Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:41:24.990585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7c72ff79bb364f0d9bc9d9397abd5318", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7c72ff79bb364f0d9bc9d9397abd5318"}]}] Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4acef8b517cc41e684dfa9b3a765edb8 Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:24.991765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '45955b1d-8032-4459-bc14-9ce82c8583ed'} Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:41:24.992935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:24.996038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:24.997501 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Returning 404 to user: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:41:24.997501 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a30c2768-605d-4e47-a7a6-f1bd3fafd2d4 tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "DELETE /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 404 len: 111 microversion: 2.1 time: 0.059778 Jun 15 00:41:24.997501 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 89/184] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:41:24 2022] DELETE /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:25.002696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:25.003407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] [instance: 45955b1d-8032-4459-bc14-9ce82c8583ed] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:25.009794 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.010720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.011638 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.012113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.026404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] HTTP exception thrown: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Request method failure captured: Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed HTTP/1.1 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSpt1Yu6TUlmspmkhX-Nbj05NJ3yg75Kye8cMwFPNI20GI66uxZeH6hmzBx0ScegtYpJQhsrMUPNjRspUvP3AdZN20wBe9_ibqdDzEzuFhduzfrJd1qaE-J5_m34QO1FHyJe8lHxAtg_2hkRUiFHTxXEQxqGpVpe1NfT5ysXOTVn0YU Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:41:25.031894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7c72ff79bb364f0d9bc9d9397abd5318", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7c72ff79bb364f0d9bc9d9397abd5318"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7c72ff79bb364f0d9bc9d9397abd5318"}]}] Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 7c72ff79bb364f0d9bc9d9397abd5318 Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-DeleteServersTestJSON-1534234548 Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 4acef8b517cc41e684dfa9b3a765edb8 Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-DeleteServersTestJSON-1534234548-project Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:25.033317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '45955b1d-8032-4459-bc14-9ce82c8583ed'} Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:41:25.034109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. Jun 15 00:41:25.035150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:41:25.036904 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] Returning 404 to user: Instance 45955b1d-8032-4459-bc14-9ce82c8583ed could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:41:25.038050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-881a1b47-a6d4-4652-8857-6805f04f99db tempest-DeleteServersTestJSON-1534234548 tempest-DeleteServersTestJSON-1534234548-project] 10.222.0.17 "GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed" status: 404 len: 111 microversion: 2.1 time: 0.039429 Jun 15 00:41:25.038613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 96/185] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:24 2022] GET /compute/v2.1/servers/45955b1d-8032-4459-bc14-9ce82c8583ed => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:25.554989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:25.555638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:25.568767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.569418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.570560 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.571144 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.578275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:25.765971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:25.767213 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:25.790011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.791396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.797284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:25.798983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:25.962828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:25.974064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-eb1ff8b7-c5b5-43e2-bebd-f4441e686b57 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.423790 Jun 15 00:41:25.985482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 90/186] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:25 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:26.094109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:26.102468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e5942545-1ea2-4280-9669-148bf947675d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.343229 Jun 15 00:41:26.105198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 97/187] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:25 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:26.643732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-0d9b0571-34c3-4e68-b3e6-eacc9dae1907 req-35fa4320-377a-4669-9a49-3eaf6f125271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3e650b-baf1-4651-a3a8-8173b67d7c96", "tag": "50c564a2-f934-443f-aa5e-670ab0c6b370"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:26.667746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0d9b0571-34c3-4e68-b3e6-eacc9dae1907 req-35fa4320-377a-4669-9a49-3eaf6f125271 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:26.668388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0d9b0571-34c3-4e68-b3e6-eacc9dae1907 req-35fa4320-377a-4669-9a49-3eaf6f125271 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:26.682921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-0d9b0571-34c3-4e68-b3e6-eacc9dae1907 req-35fa4320-377a-4669-9a49-3eaf6f125271 service nova] Creating event network-changed:50c564a2-f934-443f-aa5e-670ab0c6b370 for instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 on hv-cinder-84517 Jun 15 00:41:26.688339 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-0d9b0571-34c3-4e68-b3e6-eacc9dae1907 req-35fa4320-377a-4669-9a49-3eaf6f125271 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059175 Jun 15 00:41:26.689440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 91/188] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:26.994257 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:26.999110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:27.014492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:27.015099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:27.015926 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:27.016373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:27.119938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:27.121255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:27.128199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:27.128642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:27.129433 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:27.130071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:27.167843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:27.176544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-52eac00d-9e30-4768-bf6f-e8101b3b0cb0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.188571 Jun 15 00:41:27.178339 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:26 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:27.287727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:27.295150 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aa92b037-9e8d-4dfb-b940-23ea5337c9b8 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.178845 Jun 15 00:41:27.295720 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 92/190] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:27 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:28.194550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:28.195147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:28.201908 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:28.202341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:28.203224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:28.203644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:28.314260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:28.315637 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:28.323093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:28.326134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:28.327143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:28.327811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:28.430268 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:28.430268 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:28.434169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-29063464-b390-4d93-b5e9-4ec406e69aa4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.243618 Jun 15 00:41:28.444417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 99/191] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:28 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:28.526843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:28.534902 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-34dc50ee-73fa-46f7-8020-d5a35a550557 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.226501 Jun 15 00:41:28.535477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 93/192] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:28 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:29.451522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:29.452149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:29.458697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:29.459142 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:29.460072 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:29.460498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:29.552555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:29.553087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:29.562704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:29.564120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:29.565726 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:29.567514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:29.693082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:29.702391 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4cb44fc8-310b-482e-bbae-5d6ee09a35c6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.255663 Jun 15 00:41:29.704079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 100/193] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:29 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:29.776653 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:29.787384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1346df66-4aa0-4c85-93f3-f597de9a1194 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.238576 Jun 15 00:41:29.788528 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 94/194] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:29 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:30.720828 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:30.721602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:30.728652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:30.729093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:30.729853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:30.730280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:30.805071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:30.806255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:30.816065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:30.820611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:30.821649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:30.822227 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:30.883030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:30.896018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-42f159b7-962a-4d84-9e84-7d3e4183e93f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.178974 Jun 15 00:41:30.897162 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 101/195] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:30 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:31.133718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:31.154578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:31.206421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:31.220742 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-faf87de0-5968-406d-b23e-117f42768c8d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.419463 Jun 15 00:41:31.222921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 95/196] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:30 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:31.914522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:31.918597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:31.918597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:31.922799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:31.923248 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:31.924071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:31.924503 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:32.091880 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:32.100021 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ddb39ec-e7ed-45ce-8987-f2dd0440b37b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.189236 Jun 15 00:41:32.100864 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 102/197] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:31 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:32.238683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:32.239367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:32.246865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:32.247350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:32.248140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:32.248728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:32.298222 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6630d31d-2c1f-40ef-8fdc-acefb7eea6e6 req-ea6e862f-84bb-42b0-9b9c-9d58fb9707b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3e650b-baf1-4651-a3a8-8173b67d7c96", "name": "network-vif-plugged", "status": "completed", "tag": "50c564a2-f934-443f-aa5e-670ab0c6b370"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:32.310948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6630d31d-2c1f-40ef-8fdc-acefb7eea6e6 req-ea6e862f-84bb-42b0-9b9c-9d58fb9707b4 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:32.314197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6630d31d-2c1f-40ef-8fdc-acefb7eea6e6 req-ea6e862f-84bb-42b0-9b9c-9d58fb9707b4 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:32.330936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6630d31d-2c1f-40ef-8fdc-acefb7eea6e6 req-ea6e862f-84bb-42b0-9b9c-9d58fb9707b4 service nova] Creating event network-vif-plugged:50c564a2-f934-443f-aa5e-670ab0c6b370 for instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 on hv-cinder-84517 Jun 15 00:41:32.336325 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6630d31d-2c1f-40ef-8fdc-acefb7eea6e6 req-ea6e862f-84bb-42b0-9b9c-9d58fb9707b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042863 Jun 15 00:41:32.337157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 103/198] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:32.389152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:32.396973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-97d7d17d-1ad5-412c-921e-b2ebfee13431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.162012 Jun 15 00:41:32.397554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 96/199] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:32 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:33.117732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:33.118411 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:33.125728 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:33.126169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:33.126906 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:33.127317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:33.266496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:33.273888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2f8175c9-2729-4a44-b3be-95251746811e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.160254 Jun 15 00:41:33.274497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 104/200] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:33 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:33.414346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:33.414937 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:33.421971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:33.422408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:33.423142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:33.423564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:33.555624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:33.563286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2064ac18-25d9-4c78-b702-b33060fe9ee1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.152575 Jun 15 00:41:33.563842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 97/201] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:33 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:34.290386 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:34.290986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:34.297023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:34.297463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:34.298207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:34.298630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:34.429630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:34.437842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-35faebc5-6e8c-4058-b15e-fa14efdb9448 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.151299 Jun 15 00:41:34.448287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 105/202] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:34 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:34.581068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:34.581680 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:34.588311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:34.597768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:34.597768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:34.597768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:34.731970 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:34.742940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-50874e83-ef35-4837-8e0b-bb00778df34d tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1314 microversion: 2.1 time: 0.165579 Jun 15 00:41:34.743307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 98/203] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:34 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:35.455098 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:35.455734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:35.461759 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.462195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:35.463027 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.463492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:35.608579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:35.610472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0a7069f9-13d9-470f-b54d-b25f3b735b45 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.159129 Jun 15 00:41:35.611035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 106/204] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:35 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:35.759641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:35.760279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:35.767996 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.770546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:35.770546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.770546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:35.921372 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:35.928802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a4f22c64-cb46-4880-a532-75f4343ac6b0 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1463 microversion: 2.1 time: 0.172949 Jun 15 00:41:35.929353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 99/205] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:35 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1463 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:35.968897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:35.969091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:35.975475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.976164 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:35.977152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:35.977968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:36.011849 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:41:36.341000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1e1c3722-e855-4da5-94b5-51c157fa8dc1 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 204 len: 0 microversion: 2.1 time: 0.375957 Jun 15 00:41:36.342186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 107/206] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:41:35 2022] DELETE /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:41:36.349955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:36.351200 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:36.358051 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:36.358613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:36.359567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:36.360123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:36.546064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:36.553497 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-04e4477b-4bd3-4710-8f8e-a8a59ac3f0da tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1469 microversion: 2.1 time: 0.207304 Jun 15 00:41:36.554059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 100/207] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:36 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:36.627734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:36.628455 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:36.630351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:36.634958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:36.635649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:36.636428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:36.636861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:36.833652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:36.843104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-226d6ec5-acde-4693-a78c-5b9901013aff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.219571 Jun 15 00:41:36.844132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 108/208] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:36 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:37.571340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:37.571954 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:37.579984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:37.580503 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:37.581574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:37.582367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:37.717616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:37.725425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cc821f95-0bc8-4def-86e5-b775d6f10175 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1469 microversion: 2.1 time: 0.157849 Jun 15 00:41:37.725995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 101/209] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:37 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:37.860346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:37.860984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:37.867506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:37.867972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:37.868734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:37.869164 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:38.062493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:38.070316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f5da464e-a955-4e3a-9b32-8204a78af7fb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.214451 Jun 15 00:41:38.071139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 109/210] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:37 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:38.742517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:38.743119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:38.750185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:38.750632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:38.751379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:38.751804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:38.969771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-16fd9dd9-05f8-495f-be2d-b3d271b0356a req-b14cc087-e72e-4458-a874-79e49c14ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3e650b-baf1-4651-a3a8-8173b67d7c96", "name": "network-vif-deleted", "tag": "50c564a2-f934-443f-aa5e-670ab0c6b370"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:38.987256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-16fd9dd9-05f8-495f-be2d-b3d271b0356a req-b14cc087-e72e-4458-a874-79e49c14ecc5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:38.988075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-16fd9dd9-05f8-495f-be2d-b3d271b0356a req-b14cc087-e72e-4458-a874-79e49c14ecc5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:39.002275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-16fd9dd9-05f8-495f-be2d-b3d271b0356a req-b14cc087-e72e-4458-a874-79e49c14ecc5 service nova] Creating event network-vif-deleted:50c564a2-f934-443f-aa5e-670ab0c6b370 for instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 on hv-cinder-84517 Jun 15 00:41:39.007607 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-16fd9dd9-05f8-495f-be2d-b3d271b0356a req-b14cc087-e72e-4458-a874-79e49c14ecc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054062 Jun 15 00:41:39.008575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 110/211] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:41:39.078614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:39.092673 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0f82f215-3d4c-4c69-9fe0-7faaa5140bd2 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1427 microversion: 2.1 time: 0.353883 Jun 15 00:41:39.094397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 102/212] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:38 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1427 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:39.095022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:39.095709 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:39.106380 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:39.107732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:39.108786 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:39.109843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:39.297947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:39.308124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9c52664c-1a09-4b29-ba88-62bb0bf59749 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.218709 Jun 15 00:41:39.308844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 111/213] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:39 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:40.112468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:40.112468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:40.117999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:40.118442 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:40.119197 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:40.119793 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:40.152574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:40.153024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:40.154219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lazy-loading 'fault' on Instance uuid 1c3e650b-baf1-4651-a3a8-8173b67d7c96 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:41:40.201749 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94db038cce364dd487ee170a4e1c8ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:40.210890 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b51958fb-8de1-40e0-8237-ea2f053439ad tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 200 len: 1304 microversion: 2.1 time: 0.104094 Jun 15 00:41:40.211815 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 103/214] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:40 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:40.326145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:40.333251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:40.338986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:40.339933 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:40.341317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:40.342381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:40.495101 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:40.503333 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2130adc0-2c60-4f31-89a6-ab6e0eb9bb9a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.181723 Jun 15 00:41:40.503900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 112/215] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:40 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:41.227100 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:41.228536 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] [instance: 1c3e650b-baf1-4651-a3a8-8173b67d7c96] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:41.235588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:41.236115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:41.236868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:41.238627 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:41.250426 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] HTTP exception thrown: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Request method failure captured: Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 HTTP/1.1 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSquWZDXg8Qvhj5ZpyNz6H_LHO5OSB55IEfIHBkNPlv7Uq5YqRnm7pUdzX9xS2muz4HNUdNN8Jk3yuZkC-F4_pRb4qOvWWfvhBxAM7BYJ_2vdUHbfXWSLCRIOHFhiRX1QvgNugTEcjcqisu1MLhtNqCItR33hTfLRjl8BHRkB2EkWsw Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c44c4f14b5f04c2aa6585ac5d3b2d2a8 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesNegativeTest-918690476 Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:41:41.252128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c44c4f14b5f04c2aa6585ac5d3b2d2a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c44c4f14b5f04c2aa6585ac5d3b2d2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c44c4f14b5f04c2aa6585ac5d3b2d2a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c44c4f14b5f04c2aa6585ac5d3b2d2a8"}]}] Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesNegativeTest-918690476 Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c44c4f14b5f04c2aa6585ac5d3b2d2a8 Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesNegativeTest-918690476 Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesNegativeTest-918690476-project Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 94db038cce364dd487ee170a4e1c8ad0 Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesNegativeTest-918690476-project Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. Jun 15 00:41:41.253585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '1c3e650b-baf1-4651-a3a8-8173b67d7c96'} Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:41:41.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. Jun 15 00:41:41.255898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:41:41.256917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] Returning 404 to user: Instance 1c3e650b-baf1-4651-a3a8-8173b67d7c96 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:41:41.256917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e7f29770-237e-49b5-8283-aa64a9e53431 tempest-VolumesNegativeTest-918690476 tempest-VolumesNegativeTest-918690476-project] 10.222.0.17 "GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96" status: 404 len: 111 microversion: 2.1 time: 0.030485 Jun 15 00:41:41.256917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 104/216] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:41 2022] GET /compute/v2.1/servers/1c3e650b-baf1-4651-a3a8-8173b67d7c96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:41.520536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:41.521186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:41.527509 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:41.528249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:41.530575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:41.532295 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:41.679118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:41.687599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d67277f6-0462-4e18-9450-37f02db8a7fd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.170916 Jun 15 00:41:41.688201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 113/217] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:41 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:42.708170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:42.708170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:42.713391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:42.713843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:42.714601 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:42.715367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:42.888440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:42.896283 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-22aa5b8e-e575-411d-a4e5-36e80a949dff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.196326 Jun 15 00:41:42.897523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 105/218] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:42 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:43.914899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:43.915888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:43.924232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:43.924680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:43.925439 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:43.925866 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:44.110928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:44.121518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2946b914-8066-4672-b942-516b05344e33 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.210778 Jun 15 00:41:44.122112 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 114/219] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:43 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:45.140371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:45.140971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:45.144870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:45.148635 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:45.149313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:45.150075 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:45.150657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:45.353461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:45.358880 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-851f5d21-d54a-4014-b949-a33241ba3295 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.224302 Jun 15 00:41:45.359799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 106/220] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:45 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:46.376724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:46.377326 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:46.393686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:46.394143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:46.394914 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:46.395370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:46.575570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:46.583986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4120f0cb-cd54-47e9-bd8a-23b0b188347b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.211759 Jun 15 00:41:46.584604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 115/221] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:46 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:47.603626 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:47.604364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:47.611474 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:47.612118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:47.613245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:47.613844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:47.802448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:47.806058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:47.810938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-be84f9ce-e441-4aeb-acb7-43c949490a67 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1522 microversion: 2.1 time: 0.213433 Jun 15 00:41:47.811497 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 107/222] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:47 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:48.833148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:48.833750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:48.844265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:48.844265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:48.844265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:48.844265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:48.846296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:48.977796 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:48.986579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6c9854db-9260-4ff1-8d0c-8416ccae3201 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1502 microversion: 2.1 time: 0.157369 Jun 15 00:41:48.987106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 116/223] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:48 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:41:49.004011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:49.004011 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:49.011384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:49.011824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:49.012601 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:49.013022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:49.174086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:49.182765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f654daa3-bf10-4db4-880c-a993d97c6cc2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1515 microversion: 2.1 time: 0.183606 Jun 15 00:41:49.183327 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 108/224] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:48 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:53.207345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:41:53.208299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:53.214930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:53.224532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:53.224532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:53.224532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:53.241650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lazy-loading 'flavor' on Instance uuid f6969bf2-cd90-4330-8d7f-bcc914245566 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:41:53.586909 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-438a63d3-3583-4ebc-9629-774f17370a4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/action" status: 200 len: 32 microversion: 2.1 time: 0.383691 Jun 15 00:41:53.593324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 117/225] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:41:53 2022] POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:41:53.598779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:53.599464 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:53.611416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:53.611416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:53.611416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:53.611416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:53.801394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:53.809602 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-14924444-6918-422d-ade5-1b4673c83c05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.215199 Jun 15 00:41:53.810279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 109/226] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:53 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:54.828189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:54.829606 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:54.836896 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:54.837590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:54.838412 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:54.839027 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:54.991745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:55.001224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-685f66c1-2a9b-456c-bfad-7d419522a853 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.177775 Jun 15 00:41:55.001717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 118/227] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:54 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:56.019899 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:56.021393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:56.028689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:56.029649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:56.031367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:56.031934 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:56.188978 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:56.191045 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:56.196642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:56.205417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:56.208929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:56.211394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:56.211968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:56.213252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-36724d21-c2c6-48d2-aca1-9c640d686909 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.198318 Jun 15 00:41:56.213831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 110/228] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:56 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:56.252610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-52dab7d8-a305-4519-a968-9c9c3203f38b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/ips" status: 200 len: 147 microversion: 2.1 time: 0.069532 Jun 15 00:41:56.259188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 119/229] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:41:56 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/ips => generated 147 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:41:57.230476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:57.231650 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:57.239828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:57.240487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:57.241409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:57.241991 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:57.400853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:57.411099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f827bc44-9f66-4fed-93a5-6aa503d6caef tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.184354 Jun 15 00:41:57.417333 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 111/230] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:57 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:57.778846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:57.779390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:57.788220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:57.788928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:57.790408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:57.793550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:57.819936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-10af0dc9-1d9f-472a-b3e3-9ecbc045dca0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/ips" status: 200 len: 153 microversion: 2.20 time: 0.044698 Jun 15 00:41:57.822532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 120/231] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jun 15 00:41:57 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:41:58.430495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:58.431099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:58.438896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:58.439346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:58.440150 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:58.440563 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:58.616049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:41:58.625250 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-28a3e017-6bf5-4c5b-886d-5aa72833b9b5 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.198468 Jun 15 00:41:58.625821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 112/232] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:58 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:41:59.656557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:41:59.657152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:41:59.674447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:59.675068 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:41:59.675835 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:41:59.677700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:00.034608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:00.044788 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-385e296d-a64b-4ff7-a2fa-2980e9280360 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.405644 Jun 15 00:42:00.045778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 121/233] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:41:59 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:01.062689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:01.063286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:01.071221 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:01.071674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:01.072473 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:01.073258 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:01.220158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:01.229053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-98a11b2a-f450-498d-8eb9-e83b1648ec0a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.170873 Jun 15 00:42:01.239440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 113/234] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:01 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:02.247097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:02.247854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:02.255537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:02.256079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:02.256993 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:02.257765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:02.402365 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:02.410850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-31416cf0-b671-4f70-91b2-84b634b56cb9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.167826 Jun 15 00:42:02.411551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 122/235] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:02 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:03.428983 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:03.433739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:03.443824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:03.444666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:03.445584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:03.446124 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:03.792298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:03.800769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ae1d06f5-fb2f-46a8-9191-b9c72ce29ffa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.376093 Jun 15 00:42:03.802038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 114/236] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:03 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:04.820535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:04.825032 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:04.829387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:04.830055 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:04.831130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:04.831618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:05.083773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:05.093254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2e91ec34-48f7-4508-a855-8122b49d7897 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.277780 Jun 15 00:42:05.093836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 123/237] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:04 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:05.576711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-49aeadfd-1b35-4ce8-8dc4-fb1e3d81c50b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Action: 'create', calling method: .version_select at 0x7fa824309280>, body: {"keypair": {"name": "tempest-TestShelveInstance-567236908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZZa1ivQH4Zczb40CdS3H9uFXIZ0jiRtyDiQFjfWNd+X9ImipyCpqq6b4OGgTqT3+zS5N0hKDGtPOLdFJMvy4B2Sjv/Ub92jkwgW3C//pmpsoOirWpH8iR1hZgUFBqGbg=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:05.597342 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-49aeadfd-1b35-4ce8-8dc4-fb1e3d81c50b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Getting quotas for project 4020df94dce44ce6bfe88478e6efa55f. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:05.601436 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-49aeadfd-1b35-4ce8-8dc4-fb1e3d81c50b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Getting quotas for user 7488c1659ed64e9bb4c28a7284578d29 and project 4020df94dce44ce6bfe88478e6efa55f. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:05.715570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-49aeadfd-1b35-4ce8-8dc4-fb1e3d81c50b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.368737 Jun 15 00:42:05.717521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 115/238] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:42:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:42:06.114166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:06.114166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:06.121876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:06.123526 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:06.124382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:06.125007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:06.544312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:06.558395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d0b0d9f2-9b93-4560-a4b6-994a2c20da38 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.451166 Jun 15 00:42:06.559046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 124/239] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:06 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:07.578517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:07.579413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:07.587121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:07.587670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:07.588614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:07.589119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:07.771746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:07.781122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f9880509-01f6-47ea-b26f-174906a619be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.208085 Jun 15 00:42:07.781736 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 116/240] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:07 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:08.798533 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:08.799149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:08.805524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:08.805968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:08.806735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:08.807168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:08.943103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:08.952019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a79e4f2d-464a-494c-b8c3-9ee5af790344 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.158221 Jun 15 00:42:08.961853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 125/241] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:08 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:09.926989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:09.927925 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:09.937939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:09.938665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:09.939780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:09.940363 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:09.964159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'flavor' on Instance uuid 4384856b-b368-4857-a5d7-431d19403918 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:42:09.968845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:09.969515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:09.973519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=36 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:09.977116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:09.977620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:09.978697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:09.979191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:10.114730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:10.122867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ccc69c3-c342-4d9b-8b0e-a15211473fb1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.157992 Jun 15 00:42:10.124320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 126/242] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:09 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:10.129736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c93ff64e-b9cd-4b9e-999f-0f84e1c13950"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:10.130915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:10.137040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:10.137487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:10.138240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:10.140367 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:11.016152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5b2a8ae5-8e2f-43b6-b54c-88b6b17b186c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890039 Jun 15 00:42:11.017020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 127/243] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:42:10 2022] POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:42:11.143131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:11.143815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:11.150123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:11.150607 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:11.151362 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:11.151790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:11.290752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:11.298796 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bb6c0e0b-6b61-4002-932e-f40892b64c07 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.161184 Jun 15 00:42:11.299467 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 128/244] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:11 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:12.316480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:12.317300 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:12.326542 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:12.328640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:12.329574 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:12.330004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:12.474763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:12.487947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dae9ed86-a3ac-4411-8f4d-654fce98922e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.174989 Jun 15 00:42:12.488506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 129/245] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:12 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:13.505250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:13.505888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:13.512747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:13.513174 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:13.513927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:13.514875 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:13.518971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:13.668780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:13.681947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e5a754d3-06bd-4eec-979c-406ce2f7ed16 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.175120 Jun 15 00:42:13.681947 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 130/246] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:13 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:14.694528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:14.695200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:14.703128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:14.703700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:14.704563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:14.705087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:14.862216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:14.870871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4fa08271-7be0-4ca0-a253-1498882b3f7b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.181403 Jun 15 00:42:14.871556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 131/247] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:14 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:15.608970 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:15.890583 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:15.891885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:15.898472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:15.898907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:15.899662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:15.900122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:16.042691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:16.051189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-03714586-ac51-43e8-b681-7b9a6b45baf6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.165051 Jun 15 00:42:16.051745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 132/248] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:15 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:17.068240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:17.068867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:17.075178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:17.075621 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:17.076394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:17.076812 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:17.203510 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:17.210807 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-32630ac3-2650-4b35-a8af-2b76ac142cc1 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.146354 Jun 15 00:42:17.211361 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 133/249] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:17 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:18.228074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:18.228771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:18.235539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:18.236005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:18.236751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:18.237173 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:18.371323 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:18.378946 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2ee990e3-1ef6-4d0d-9af1-b4f2494221c8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.154785 Jun 15 00:42:18.379509 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 134/250] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:18 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:19.396569 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:19.397169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:19.406292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:19.406737 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:19.407495 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:19.413306 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:19.538085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:19.545927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6fe932a4-016a-4b1e-8d50-599106d01e27 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.153252 Jun 15 00:42:19.546487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 135/251] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:19 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:19.810104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-85aa6fe5-9bdb-4158-9a6d-1df297be54dd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:19.817212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85aa6fe5-9bdb-4158-9a6d-1df297be54dd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:19.817785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-85aa6fe5-9bdb-4158-9a6d-1df297be54dd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:19.880455 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-85aa6fe5-9bdb-4158-9a6d-1df297be54dd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Going to try to stop instance {{(pid=124683) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 00:42:19.933523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:20.059330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-85aa6fe5-9bdb-4158-9a6d-1df297be54dd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action" status: 202 len: 0 microversion: 2.1 time: 0.253114 Jun 15 00:42:20.059994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 136/252] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:42:19 2022] POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 00:42:20.073646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:20.074382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:20.081055 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:20.081497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:20.082247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:20.082670 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:20.194272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:20.219633 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:20.227493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d911d2d9-7cc3-4c08-9eb3-503de6769788 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.158448 Jun 15 00:42:20.228075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 137/253] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:20 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:20.563543 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:20.564221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:20.570831 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:20.571272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:20.572054 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:20.572486 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:20.719302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:20.728735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4177dd64-8734-4e80-b031-95f354be6f84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.169350 Jun 15 00:42:20.729289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 138/254] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:20 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:21.244845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:21.245445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:21.252263 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:21.252706 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:21.253481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:21.253911 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:21.383409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:21.394476 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-09a65f9e-2cdc-424e-ae0c-04a24807114d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.153388 Jun 15 00:42:21.395193 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 139/255] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:21 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:21.745139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:21.745726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:21.753264 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:21.753706 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:21.754494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:21.754917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:21.894218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:21.906296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-46f2f80f-f137-4885-88f6-bd975f5d9fff tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.164486 Jun 15 00:42:21.906746 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 140/256] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:21 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:22.412522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:22.413523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:22.419457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:22.419878 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:22.421004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:22.421124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:22.552331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:22.560937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-82dda6cf-a67b-41b3-92d0-cfd6de70cd33 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.152029 Jun 15 00:42:22.561669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 141/257] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:22 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:22.928162 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:22.928828 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:22.935139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:22.935718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:22.936522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:22.936946 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:23.073380 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:23.086097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-21e32313-100c-48c3-a13a-fd93c7d3182b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.161928 Jun 15 00:42:23.086671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 142/258] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:22 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:23.580856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:23.580856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:23.585039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:23.585478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:23.586246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:23.586670 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:23.724519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:23.733244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7949b79d-edd1-47b0-9b5b-f1ac5eb2f5cc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.158567 Jun 15 00:42:23.733814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 143/259] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:23 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:24.102251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:24.102937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:24.110647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:24.111102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:24.111945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:24.116672 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:24.261667 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:24.271276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0955e700-dafb-460c-8155-4513dc2d551b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.172695 Jun 15 00:42:24.272016 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 144/260] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:24 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:24.753263 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:24.754270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:24.761373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:24.762144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:24.763430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:24.764100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:24.911298 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:24.914383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:24.927012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c736a70c-51cd-4bd6-ac8d-36ea1cc3fd7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.178517 Jun 15 00:42:24.928500 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 145/261] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:24 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:25.290393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:25.291048 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:25.299109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:25.299547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:25.300352 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:25.300775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:25.434701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:25.442158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e3dc1c3c-3be9-4980-b0d0-6cc91191f4ca tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.155740 Jun 15 00:42:25.451417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 146/262] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:25 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:25.945726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:25.946579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:25.953767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:25.954214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:25.954972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:25.955406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:26.102883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:26.111416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7c7be935-cf18-4f46-9c9b-cb949bd440d5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.169554 Jun 15 00:42:26.112023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 147/263] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:25 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:26.460494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:26.460494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:26.465877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:26.466321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:26.467089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:26.467520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:26.630910 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:26.661723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81cbc344-c93f-4c79-9ce4-4bd247ee4504 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.198493 Jun 15 00:42:26.662344 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 148/264] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:26 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:27.129100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:27.130115 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:27.138247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:27.138794 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:27.139582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:27.140601 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:27.372331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:27.380780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-afa33671-5406-4c77-a863-3fc5b0203f85 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.256660 Jun 15 00:42:27.381354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 149/265] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:27 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:27.679615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:27.680390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:27.691990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:27.693519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:27.695469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:27.695469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:27.864413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:27.872387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1b7524ed-f55e-4f72-ba6e-c900bf4e7ffb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.197530 Jun 15 00:42:27.873143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 150/266] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:27 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:28.399052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:28.400004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:28.407355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:28.408089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:28.408937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:28.409390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:28.542289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:28.550780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-59850c73-a56f-4e05-bcf3-ab358b8fc6df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.155790 Jun 15 00:42:28.551345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 151/267] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:28 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:28.893505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:28.893505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:28.897396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:28.897995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:28.898750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:28.899181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:29.043776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:29.052274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4f542281-6374-4940-a9c2-9d5295d92348 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.165850 Jun 15 00:42:29.052851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 152/268] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:28 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:29.568083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:29.568674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:29.574742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:29.575178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:29.575953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:29.576387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:29.704650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:29.712529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2332a26f-93e3-4adb-b4fe-1fe14037e736 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.148316 Jun 15 00:42:29.713079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 153/269] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:29 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:30.019447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1414918844", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "networks": [{"uuid": "653b6765-3e05-4b90-a296-9901f0b92538"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:30.556100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] validate_networks() for [('653b6765-3e05-4b90-a296-9901f0b92538', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:42:30.770002 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f8dbe685-00da-40c3-8806-853a25a8f6d0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/action" status: 202 len: 0 microversion: 2.20 time: 20.847801 Jun 15 00:42:30.770632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 117/270] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jun 15 00:42:09 2022] POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/action => generated 0 bytes in 20849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:42:30.776252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:30.777139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:30.785065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:30.785674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:30.786608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:30.787335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:30.991482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:30.999160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-83137383-4c9f-4bc0-b81a-b570d2a221d3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.227172 Jun 15 00:42:30.999729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 118/271] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:30 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:31.004166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:31.004860 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:31.007526 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:42:31.007958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:42:31.008423 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:42:31.008827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:42:31.009226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:42:31.018480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.018922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.019022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.019369 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.019671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.020149 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.020260 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.020715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.039727 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Getting quotas for project a0645668bf03499f97a2a54cbe75e3fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:31.044358 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Getting quotas for user b7de51e3989248088b608a5d50400064 and project a0645668bf03499f97a2a54cbe75e3fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:31.055627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:42:31.057912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:42:31.153584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:31.161488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1bc373bd-7160-4be2-9c76-3c66f65747d2 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.160790 Jun 15 00:42:31.162222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 119/272] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:30 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:31.166408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:31.166997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:31.172804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.173246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.173997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:31.174422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:31.233834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-90f80133-7d1f-4720-ba7f-03eeb899137a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218244 Jun 15 00:42:31.239277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 154/273] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:42:31.244800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ebbf49e-ac83-4d48-96c7-0ce2dcfdc226 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:31.245604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ebbf49e-ac83-4d48-96c7-0ce2dcfdc226 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:31.318965 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ebbf49e-ac83-4d48-96c7-0ce2dcfdc226 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:31.328664 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ebbf49e-ac83-4d48-96c7-0ce2dcfdc226 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1214 microversion: 2.1 time: 0.087636 Jun 15 00:42:31.330014 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 155/274] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:31 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:31.335289 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:31.357390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:31.357390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:31.357390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b116762f-e82a-40e1-ae6a-0baab8fabbd9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.185000 Jun 15 00:42:31.357701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 120/275] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:31 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:32.016618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:32.017334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:32.023542 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.024182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.025030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.025527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.156635 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.164375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-03f2a6ec-7f74-40ee-ae6e-8565327c2d19 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.151658 Jun 15 00:42:32.164940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 156/276] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:32 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:32.178439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:32.179627 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:32.185891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.186432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.187286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.187782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.323636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.333133 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e30352c5-b4eb-438d-84a7-77025dac65d7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.158359 Jun 15 00:42:32.333750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 121/277] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:32 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:32.346464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:32.347086 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:32.353024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.353467 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.354203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.354627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.375723 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:32.376574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:32.383421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.383866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.385546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:32.385829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:32.416252 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.423804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5ec80b55-a6b6-4ae7-9786-7a1a721e6a0d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1218 microversion: 2.1 time: 0.081773 Jun 15 00:42:32.424393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 157/278] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:32 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:32.520462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.529152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.531779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:32.532786 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e679b74-21c8-485e-bcdd-9f3e1f5672e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.161490 Jun 15 00:42:32.533391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 122/279] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:32 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:33.187897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:33.188569 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:33.195513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.195976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.196735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.197161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.334854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.342242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ccddfd8-311d-4fe0-a354-162d8482de25 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.158986 Jun 15 00:42:33.343289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 158/280] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:33 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:33.352850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:33.353451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:33.360484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.360926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.361672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.362100 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.447582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:33.448321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:33.454518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.455068 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.455930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.456428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.490240 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.498412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-06d5f6d5-3720-4412-8d1a-1abfe419df77 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.149447 Jun 15 00:42:33.499212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 123/281] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:33 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:33.520182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.528757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-397246e9-5e08-4713-946e-240a5e1afd7d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1210 microversion: 2.1 time: 0.084998 Jun 15 00:42:33.532096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 159/282] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:33 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:33.552356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:33.564758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:33.564758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.564758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.564758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:33.565439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:33.695131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.701307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.703894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:33.705072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8c8e8a99-00bc-4e69-b020-2e58f9b95931 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.157618 Jun 15 00:42:33.705621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 124/283] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:33 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:34.359729 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:34.360362 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.366898 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.367340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.368133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.368562 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.494800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.502806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fecbfa71-c1f0-4af1-989c-03cfeafeabf8 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1501 microversion: 2.1 time: 0.146884 Jun 15 00:42:34.503370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 160/284] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:34 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:34.514904 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:34.515497 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.519101 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7cf98d4-9c68-4dab-8b60-efeb26f2d919"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:34.520334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.522481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.522481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.523258 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.523681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.526705 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.527157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.529246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.529246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.553660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] HTTP exception thrown: Cannot 'attach_volume' instance f6969bf2-cd90-4330-8d7f-bcc914245566 while it is in vm_state rescued Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Request method failure captured: Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/os-volume_attachments HTTP/1.1 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 74 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp6FerWeLuXsL_HulJ96wnm6NE0Rq3zf3omo9rkXGGvCB2ssQqm5WyRzI7WugYX27UaFxAyu8yzbGtNntz1VIR1LLTnRHD4CzIKgY9f0RHkOnrAVSzGw8l82C7w_8b44rmnXpdxqECdw5ZM6f7EfLqq6nrAy2txzEPhWP0qllabxcE Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:42:34.555359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdef82f627f42b29f6da17f6bad6dd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdef82f627f42b29f6da17f6bad6dd4"}]}] Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 4989693e66c44d6a8e5f8543f1b9c516 Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {"volumeAttachment": {"volumeId": "e7cf98d4-9c68-4dab-8b60-efeb26f2d919"}} Jun 15 00:42:34.562917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Cannot 'attach_volume' instance f6969bf2-cd90-4330-8d7f-bcc914245566 while it is in vm_state rescued Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'server_id': 'f6969bf2-cd90-4330-8d7f-bcc914245566', 'body': {'volumeAttachment': {'volumeId': 'e7cf98d4-9c68-4dab-8b60-efeb26f2d919'}}} Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:42:34.563721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f6969bf2-cd90-4330-8d7f-bcc914245566 while it is in vm_state rescued Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:42:34.564903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f6969bf2-cd90-4330-8d7f-bcc914245566 while it is in vm_state rescued Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Returning 409 to user: Cannot 'attach_volume' instance f6969bf2-cd90-4330-8d7f-bcc914245566 while it is in vm_state rescued {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cafd0d4a-12e4-42d1-a4e6-832694e3fdac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041783 Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 161/285] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:42:34 2022] POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 00:42:34.568821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:34.570647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.581716 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.582490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.583492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.584597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.692499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.701238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ea244e17-70fa-4403-a6ab-41f7a4bfce01 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1274 microversion: 2.1 time: 0.142852 Jun 15 00:42:34.701733 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 162/286] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:34 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:34.715425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:34.717538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.723282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.726940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.726940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.726940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.726940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.737252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3678bc9a-2ee8-4766-b48d-d17e6dcb6edc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.226592 Jun 15 00:42:34.737840 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 125/287] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:34 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:34.751888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:34.752824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.759029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.759756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.761159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.761951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.791062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:34.903564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.913797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.915294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:34.916538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7b6f98d5-9f9f-4fe1-9038-74d9594a93bb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.176996 Jun 15 00:42:34.917289 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 126/288] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:34 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:34.934251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b225c60f-b4d6-44b4-8580-c567764374f6 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/action" status: 202 len: 0 microversion: 2.1 time: 0.222373 Jun 15 00:42:34.935410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 163/289] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:42:34 2022] POST /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:42:34.943725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:34.944558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:34.960641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.961237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:34.962068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:34.962606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.105466 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:35.113720 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-971e1422-c107-4683-bb90-83c4042fec51 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1509 microversion: 2.1 time: 0.173990 Jun 15 00:42:35.114324 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 127/290] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:34 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:35.733192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:35.733932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:35.741576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.742021 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.742782 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.743214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.755210 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:35.758353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:35.763847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.764330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.765657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.766354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.948353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:35.951344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:35.957744 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ddde07f4-287a-460c-9c97-149c9c61b558 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.237057 Jun 15 00:42:35.958654 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 164/291] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:35 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:35.967770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6fef7bba-299a-4e55-8043-6c9db5cd87c4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.209506 Jun 15 00:42:35.967770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 128/292] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:35 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:35.967770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:35.967770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:35.972733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.973172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:35.973927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:35.974477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.107758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:36.116222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:36.117724 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:36.118884 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0dc323d9-c0db-4ba9-9175-2a0a8d7096ff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.156443 Jun 15 00:42:36.119439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 129/293] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:35 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:36.132318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:36.132929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:36.139291 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.139761 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.140560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.141022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.275825 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:36.291296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1e174231-fbd2-4a48-ae0d-da83739bbead tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1509 microversion: 2.1 time: 0.162778 Jun 15 00:42:36.300942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 165/294] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:36 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:36.573499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-c9542bf5-bef0-49f8-a5d0-a1bfde7cf6cf req-ad196064-eed5-451f-81a1-64cfd2b49cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "085b264e-07a7-4bc7-959e-f670fc92830c", "tag": "03be6cf2-ca74-4f95-bd2f-221dcc1faf2e"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:36.582006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c9542bf5-bef0-49f8-a5d0-a1bfde7cf6cf req-ad196064-eed5-451f-81a1-64cfd2b49cc1 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.582661 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c9542bf5-bef0-49f8-a5d0-a1bfde7cf6cf req-ad196064-eed5-451f-81a1-64cfd2b49cc1 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.595589 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-c9542bf5-bef0-49f8-a5d0-a1bfde7cf6cf req-ad196064-eed5-451f-81a1-64cfd2b49cc1 service nova] Creating event network-changed:03be6cf2-ca74-4f95-bd2f-221dcc1faf2e for instance 085b264e-07a7-4bc7-959e-f670fc92830c on hv-cinder-84517 Jun 15 00:42:36.600701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-c9542bf5-bef0-49f8-a5d0-a1bfde7cf6cf req-ad196064-eed5-451f-81a1-64cfd2b49cc1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030950 Jun 15 00:42:36.601288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 130/295] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:42:36.974597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:36.975194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:36.978444 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:36.981932 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:36.982161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.982776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.983536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.983989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.986059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.986516 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:36.987244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:36.987669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:37.172012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.175824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.179705 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f7b4a04-c52c-489f-98f2-c575b5e146b5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.208871 Jun 15 00:42:37.180374 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 166/296] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:36 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:37.184020 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a9f74c65-2748-4ea3-9ea0-8edc33237c06 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.209720 Jun 15 00:42:37.184576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 131/297] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:36 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:37.185053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:37.185703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:37.192556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:37.193066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:37.193885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:37.194384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:37.308982 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:37.309733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:37.316622 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:37.317361 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:37.318313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:37.318755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:37.328979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.337382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.339101 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.340213 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5fff963d-486d-4bd6-a80a-090705c41565 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.158787 Jun 15 00:42:37.340727 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 167/298] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:37 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:37.450867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:37.458832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1ecf9eba-6ccc-4b3b-b866-f35e58ebf006 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1509 microversion: 2.1 time: 0.154026 Jun 15 00:42:37.459388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 132/299] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:37 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:38.197867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:38.198736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:38.201686 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:38.203307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:38.203531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:38.208799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.209245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.209681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.210006 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.210127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.210438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.210888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.211322 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.416505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.417031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.423172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1b897de4-5404-48b4-a5ac-077d7fcebb29 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.225186 Jun 15 00:42:38.426938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 133/300] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:38 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:38.427960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b10875fe-94c5-4ef7-a7d1-a671bb622fc7 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.234174 Jun 15 00:42:38.428837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 168/301] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:38 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:38.432986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:38.433574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:38.439820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.440425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.441573 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.442265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.475745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:38.476363 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:38.482268 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.482708 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.483492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:38.483927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:38.645573 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.654538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.658288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.658288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-844c0544-bf3b-4ced-93a3-9cfba0ce19cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.229293 Jun 15 00:42:38.658288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 134/302] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:38 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:38.664157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:38.672699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-911a2cdd-ada7-41e0-a354-f2cf489e541e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1509 microversion: 2.1 time: 0.200614 Jun 15 00:42:38.673381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 169/303] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:38 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:39.444955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:39.446171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:39.450330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:39.451057 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:39.456985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.457445 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.458214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.458362 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.458841 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.459190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.459975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.460490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.463947 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:39.665074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.671924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.703998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a8df46e-7344-417f-98fc-6af6276e24ea tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.263027 Jun 15 00:42:39.704184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fe071aff-18a0-42d9-9f85-cfa42aed347b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.257548 Jun 15 00:42:39.704755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 135/304] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:39 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:39.710224 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:39.711022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:39.713231 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 170/305] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:39 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:39.719067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:39.719404 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.719675 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:39.720401 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.721392 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.722172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.727785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.728305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.733175 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:39.733175 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:39.940576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.946343 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.950536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bfe72c85-d7b6-4c99-ae20-d6501be90704 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1515 microversion: 2.1 time: 0.236217 Jun 15 00:42:39.951426 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 171/306] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:39 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:39.958378 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-176241510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-567236908", "security_groups": [{"name": "tempest-secgroup-smoke-1478102935"}], "networks": [{"uuid": "462415d9-51fa-4dff-88ce-f301229856e7"}], "block_device_mapping_v2": [{"uuid": "88226a67-0ce9-474b-8514-894f4631cd57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:39.972409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.976110 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:39.977556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-76055e27-446f-4dd6-8346-7d78f7a31105 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.271334 Jun 15 00:42:39.978199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 136/307] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:39 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:40.549469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] validate_networks() for [('462415d9-51fa-4dff-88ce-f301229856e7', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:42:40.721205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:40.721813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:40.730826 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:40.731286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:40.733640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:40.734103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:40.931369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:40.938835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ca3f9e33-a894-460b-95ee-9238d8c58a44 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.221681 Jun 15 00:42:40.940027 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 137/308] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:40 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:40.944015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:40.944603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:40.950977 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:40.951519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:40.952304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:40.952735 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.016931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:42:41.017498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:42:41.018271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:42:41.018967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:42:41.019580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:42:41.027739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:41.030498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.031115 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.031922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.032366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.053393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Getting quotas for project 4020df94dce44ce6bfe88478e6efa55f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:41.062559 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Getting quotas for user 7488c1659ed64e9bb4c28a7284578d29 and project 4020df94dce44ce6bfe88478e6efa55f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:41.122952 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:41.127022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:42:41.129114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88226a67-0ce9-474b-8514-894f4631cd57',volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:42:41.132924 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4fd543ab-0cb1-4915-ab57-4aa778f9a098 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.192303 Jun 15 00:42:41.134548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 138/309] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:40 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:41.139540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:41.140238 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:41.147415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.148035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.149004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.149576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.286012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:41.293981 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:41.295505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:41.296690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8e21c78a-1b4c-40ab-99a1-478c6ad5a0fa tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.162308 Jun 15 00:42:41.297241 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 139/310] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:41 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:41.695019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c9e96bd6-964f-4868-97b4-4d9443856164 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: .version_select at 0x7fa8243fa670>, body: {"keypair": {"name": "tempest-keypair-1105813574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEtIHCzV3SNsDIHFcyZoKze4kHH1qY4RM2Y75jkJjlhjnySzouyekju2eVQ/e9jfhGiKEf5gbJ13tXcE6YiuJXqgOyjJbn5DLBGNLCHUf35WDwFfqjyrvbVz+HAEjvt4g=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:41.708966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-828b2f80-2205-458d-bfc0-cd17061deebf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.755659 Jun 15 00:42:41.710964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 172/311] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:42:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:42:41.723205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9f66f116-9443-4ce8-b057-96d2b2d605ac tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:41.724083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9f66f116-9443-4ce8-b057-96d2b2d605ac tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:41.725183 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-c9e96bd6-964f-4868-97b4-4d9443856164 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:41.730649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-c9e96bd6-964f-4868-97b4-4d9443856164 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for user 4989693e66c44d6a8e5f8543f1b9c516 and project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:41.784192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f66f116-9443-4ce8-b057-96d2b2d605ac tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:41.792725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9f66f116-9443-4ce8-b057-96d2b2d605ac tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1087 microversion: 2.1 time: 0.073891 Jun 15 00:42:41.792725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 173/312] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:41 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:41.815759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c9e96bd6-964f-4868-97b4-4d9443856164 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124656 Jun 15 00:42:41.816710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 140/313] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:42:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:42:41.956464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:41.957445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:41.964404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.965053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:41.966128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:41.966701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.151935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:42.152670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:42.159222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.159687 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.160526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.160960 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.168534 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.182299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-60f0b64f-74cf-40f9-a2d3-ca2d259bc056 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.226984 Jun 15 00:42:42.182299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 174/314] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:41 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:42.315336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:42.315963 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:42.316917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.322609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.323296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.324159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.324753 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.325826 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-df9342e1-c150-4fa0-b01a-53c0364ecf8f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1701 microversion: 2.1 time: 0.178988 Jun 15 00:42:42.326474 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 141/315] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:42 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:42.343829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d6ee61d5-eb66-40cc-95ab-37bb0f8a8d02 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:42.351019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6ee61d5-eb66-40cc-95ab-37bb0f8a8d02 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.351539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d6ee61d5-eb66-40cc-95ab-37bb0f8a8d02 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.456611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d6ee61d5-eb66-40cc-95ab-37bb0f8a8d02 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Going to try to start instance {{(pid=124682) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 00:42:42.530437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.538855 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.541741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.543391 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b5513cf0-ff27-40f6-b88d-fa5c77559cc0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.232729 Jun 15 00:42:42.544029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 175/316] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:42 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:42:42.739479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d6ee61d5-eb66-40cc-95ab-37bb0f8a8d02 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action" status: 202 len: 0 microversion: 2.1 time: 0.401002 Jun 15 00:42:42.741145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 142/317] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:42:42 2022] POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 00:42:42.749232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:42.749897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:42.758139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.758594 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.762685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:42.763332 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:42.808802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9ea810fb-fd65-41cb-b2d0-cf9db2f9c369 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:42.809297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9ea810fb-fd65-41cb-b2d0-cf9db2f9c369 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:42.950587 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9ea810fb-fd65-41cb-b2d0-cf9db2f9c369 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:42.957881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9ea810fb-fd65-41cb-b2d0-cf9db2f9c369 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1087 microversion: 2.1 time: 0.153875 Jun 15 00:42:42.962054 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 143/318] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:42 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1087 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:43.069572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:43.078398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2d73db83-8910-4aca-8735-99db484bb20b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1710 microversion: 2.1 time: 0.333081 Jun 15 00:42:43.079536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 176/319] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:42 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1710 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:43.196331 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:43.197619 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:43.207391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.208121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:43.209262 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.210028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:43.382035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:43.390556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e81df8d-e9cb-4c71-9cbf-3c39231b9256 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.198346 Jun 15 00:42:43.391128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 144/320] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:43 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:43.562404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:43.563001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:43.569836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.569836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:43.577197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.577197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:43.817312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:43.826746 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:43.828337 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:43.829509 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e77b855e-662b-47ee-be7a-0d5150f267e0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.271608 Jun 15 00:42:43.830060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 177/321] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:43 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:43.978613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:43.979246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:43.987042 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.987483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:43.988278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:43.988704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.088018 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:44.096149 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ae1ef2b3-d24b-4ee6-8573-e2c232578f69 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1185 microversion: 2.1 time: 0.121616 Jun 15 00:42:44.097053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 145/322] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:43 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:44.099430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:44.100214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:44.106196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.106599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.107532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.108599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.333559 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:44.341675 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5670caa8-8036-40fb-a008-70aae522783c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1710 microversion: 2.1 time: 0.249224 Jun 15 00:42:44.343225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 178/323] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:44 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1710 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:44.407046 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:44.407870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:44.414103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.414722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.415632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.416237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.636959 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:44.645026 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d7efef83-dfa9-40e9-8861-08ac737f1244 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.242267 Jun 15 00:42:44.646106 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 146/324] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:44 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:44.847517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:44.848085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:44.854618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.855058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:44.855810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:44.856274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.016465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.025548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-df42730a-83e4-409d-9150-e40bf7fef3bc req-4e5de71b-c47a-4242-b092-e12f31d84500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085b264e-07a7-4bc7-959e-f670fc92830c", "name": "network-vif-plugged", "status": "completed", "tag": "03be6cf2-ca74-4f95-bd2f-221dcc1faf2e"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:45.035077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-df42730a-83e4-409d-9150-e40bf7fef3bc req-4e5de71b-c47a-4242-b092-e12f31d84500 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.035525 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-df42730a-83e4-409d-9150-e40bf7fef3bc req-4e5de71b-c47a-4242-b092-e12f31d84500 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.041423 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.046893 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.049744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-df42730a-83e4-409d-9150-e40bf7fef3bc req-4e5de71b-c47a-4242-b092-e12f31d84500 service nova] Creating event network-vif-plugged:03be6cf2-ca74-4f95-bd2f-221dcc1faf2e for instance 085b264e-07a7-4bc7-959e-f670fc92830c on hv-cinder-84517 Jun 15 00:42:45.051150 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f7010cd4-6dda-4362-a0cc-38e22d93a206 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.207562 Jun 15 00:42:45.051842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 179/325] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:44 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:45.062784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-df42730a-83e4-409d-9150-e40bf7fef3bc req-4e5de71b-c47a-4242-b092-e12f31d84500 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041545 Jun 15 00:42:45.064230 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 147/326] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:42:45.109489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1979610237", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf2c6e3f-ec68-43e2-b22d-b041a66933c5"}], "security_groups": [{"name": "tempest-securitygroup--321959998"}], "key_name": "tempest-keypair-1105813574", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:45.118023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:45.118936 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:45.165162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.165162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.165162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.165162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.254200 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.265646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-42c04fc6-b74c-44f5-944e-dea2bfe9a6d2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1193 microversion: 2.1 time: 0.154373 Jun 15 00:42:45.266228 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 148/327] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:45 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:45.322800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] validate_networks() for [('bf2c6e3f-ec68-43e2-b22d-b041a66933c5', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:42:45.361351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:45.361879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:45.368194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.372077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.372077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.372077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.598202 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.613811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0632da00-a04e-4631-8015-750a4e015af5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1714 microversion: 2.1 time: 0.257323 Jun 15 00:42:45.614777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 149/328] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:45 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1714 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:45.662665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:45.663670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:45.671464 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.671927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.676074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.676074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.875296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:45.887609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:42:45.888107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:42:45.888519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:42:45.888929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:42:45.889902 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:42:45.893895 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0f7cb547-9328-4cf1-a577-aa34f6d442c3 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.235098 Jun 15 00:42:45.894665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 150/329] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:45 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:45.919749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.919749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.919749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:45.919749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:45.920195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:45.922499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Getting quotas for user 4989693e66c44d6a8e5f8543f1b9c516 and project bcdef82f627f42b29f6da17f6bad6dd4. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:45.933377 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:42:45.935478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:42:46.070282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:46.070889 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:46.078244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.078879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:46.080067 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.086403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:46.108718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b7b32b89-f270-49c6-9958-7d2c39b056ce tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.004862 Jun 15 00:42:46.113041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 180/330] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:42:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:42:46.123106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-11e58621-152a-4f02-9087-4b38bee0231d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:46.124181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-11e58621-152a-4f02-9087-4b38bee0231d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:46.209052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-11e58621-152a-4f02-9087-4b38bee0231d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:46.223830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-11e58621-152a-4f02-9087-4b38bee0231d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1246 microversion: 2.1 time: 0.103068 Jun 15 00:42:46.224556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 181/331] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:46 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:46.289317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:46.289317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:46.296976 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:46.298207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.301613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:46.306005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.306005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:46.310539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:46.312987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:46.314815 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8f1bc9f9-4a20-41ec-82c6-264fe308b234 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.248752 Jun 15 00:42:46.316047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 151/332] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:46 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:42:46.475400 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:46.484395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d4935b68-4c61-4012-a0ff-b03e79defec0 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1271 microversion: 2.1 time: 0.203028 Jun 15 00:42:46.485018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 182/333] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:46 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:46.911576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:46.912275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:46.919378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.919821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:46.921235 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:46.921669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.065686 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.073999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5cf223c7-528b-48fe-baa8-4212ed0f9b6e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.166517 Jun 15 00:42:47.083321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 152/334] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:46 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:47.240568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:47.241209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:47.247809 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.248274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.249046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.249470 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.265538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:47.333319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.335711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:47.336538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:47.343034 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d8a055e1-9d62-4da8-94ee-372c16063f05 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1250 microversion: 2.1 time: 0.104977 Jun 15 00:42:47.345396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 183/335] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:47 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1250 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:47.352996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-b7574806-47d4-4759-bdb3-36cfcb8b779b req-6956619c-bf71-4901-ba93-75b23122144c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:47.355891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.359065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.359941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.360393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.361840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b7574806-47d4-4759-bdb3-36cfcb8b779b req-6956619c-bf71-4901-ba93-75b23122144c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.362751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b7574806-47d4-4759-bdb3-36cfcb8b779b req-6956619c-bf71-4901-ba93-75b23122144c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.377858 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-b7574806-47d4-4759-bdb3-36cfcb8b779b req-6956619c-bf71-4901-ba93-75b23122144c service nova] Creating event network-changed:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:42:47.380539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-b7574806-47d4-4759-bdb3-36cfcb8b779b req-6956619c-bf71-4901-ba93-75b23122144c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 Jun 15 00:42:47.381504 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 184/336] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:42:47.388722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:47.502204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:47.502894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:47.509401 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.510214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.510918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.511690 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:47.512194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:47.521949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.523443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.524635 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b964525c-039e-4438-a8f8-8f972901e01e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.194199 Jun 15 00:42:47.525797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 153/337] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:47 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:47.656189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:47.663586 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3721a862-9001-4e4a-83b8-ed17f4432fdc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1271 microversion: 2.1 time: 0.165967 Jun 15 00:42:47.664288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 185/338] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:47 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:48.090971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:48.091567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:48.099841 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.100602 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.101380 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.101881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.229161 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.236862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3073c89b-a128-498f-8174-f404ab660ea1 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.149935 Jun 15 00:42:48.237422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 154/339] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:48 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:48.361585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:48.362233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:48.369244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.369688 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.370449 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.370882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.431514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.438797 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4a852f2d-4598-4d7a-8119-fe6909329429 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1250 microversion: 2.1 time: 0.082751 Jun 15 00:42:48.439355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 186/340] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:48 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:48.544035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:48.544628 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:48.551645 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.552123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.552883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.553298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.680473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:48.681074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:48.685795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.687048 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.687489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.688267 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:48.688695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:48.693946 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.695427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.696588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-73b86c54-0ece-4879-bb44-9480734ae410 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.156616 Jun 15 00:42:48.697127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 155/341] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:48 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:48.816788 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:48.824244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-94c94166-a130-492f-92ef-44a7669401ab tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1271 microversion: 2.1 time: 0.147568 Jun 15 00:42:48.824804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 187/342] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:48 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:49.254237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:49.254771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:49.260918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.261350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.262085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.262505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.457575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:49.457979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:49.464620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.465057 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.465824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.466251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.618611 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.627250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0a7da592-73c3-4647-ba07-ebb185ec4947 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1250 microversion: 2.1 time: 0.174741 Jun 15 00:42:49.628035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 188/343] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:49 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1250 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:49.640260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.647749 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6ba81caf-d3a5-42eb-89a4-7608aec9126b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1314 microversion: 2.1 time: 0.397500 Jun 15 00:42:49.648335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 156/344] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:49 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:49.714530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:49.715124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:49.721119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.721563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.722310 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.722741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.841544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:49.842339 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:49.849152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.849385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.849754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.850584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:49.851082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:49.857350 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.859689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.860953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1d6ee313-2002-450d-ad0d-c849e54c4725 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.150292 Jun 15 00:42:49.861684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 189/345] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:49 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:49.982912 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:49.992125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-430a1e8e-3fab-4475-afc3-fc0b59827179 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1271 microversion: 2.1 time: 0.154162 Jun 15 00:42:49.992891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 157/346] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:49 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:50.643600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:50.644232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:50.650833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.651212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:50.651984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.652441 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:50.666102 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:50.666823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:50.686195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.688041 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:50.688548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.689053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:50.717029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:50.727125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aa137e9f-e26d-407d-b4b6-52cea33c81c4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1242 microversion: 2.1 time: 0.084911 Jun 15 00:42:50.727125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 190/347] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:50 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:50.836451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:50.845126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-05b5bbf4-e94d-4a5e-a208-95361b8fbafb tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1498 microversion: 2.1 time: 0.183679 Jun 15 00:42:50.845793 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 158/348] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:50 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:50.881072 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:50.881465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:50.888005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.889674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:50.889674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:50.889674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:51.009034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:51.010057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:51.017465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:51.017910 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:51.021767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:51.021767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:51.037167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:51.050784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:51.050784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:51.050784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2166f9f2-165a-45c8-98c1-e9f91bf9cf1c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.173491 Jun 15 00:42:51.051017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 191/349] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:50 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:42:51.164896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:51.172738 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-39edfd25-4193-41c2-9d5a-34d376880e72 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.167816 Jun 15 00:42:51.173295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 159/350] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:51 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:51.742105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:51.742781 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:51.749398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:51.749862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:51.750610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:51.751032 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:51.815565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:51.823039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f80fbbee-2874-4e11-9a9c-d0adaacc969a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1306 microversion: 2.1 time: 0.084795 Jun 15 00:42:51.823592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 192/351] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:51 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:52.050824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:52.051358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:52.057601 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.057954 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.058722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.059157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.076767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:52.079095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:52.088436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.089187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.090216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.091406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.096447 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:42:52.236336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:52.244203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:52.245931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:52.247103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8465974b-546a-4eb2-b9e4-8224b06d1212 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.175597 Jun 15 00:42:52.247662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 193/352] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:52 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:52.252972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:52.253829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:52.266118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.266565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.267330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.267950 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.332274 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:52.459211 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4629a39d-b229-47c9-8b25-6df3c8e2c734 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 204 len: 0 microversion: 2.1 time: 0.411803 Jun 15 00:42:52.470757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 160/353] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:42:52 2022] DELETE /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:42:52.475572 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:52.476876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:52.480195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:52.488720 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.489300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.489496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fe6256d8-5b53-4966-bc58-2e169bca8977 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.237872 Jun 15 00:42:52.490371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 194/354] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:52 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:52.491581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.492135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.633287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:52.642026 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-12008f92-4410-434a-8950-b81213deee35 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1504 microversion: 2.1 time: 0.176146 Jun 15 00:42:52.642245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 161/355] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:52 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:52.841177 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:52.841781 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:52.849201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.850128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:52.850415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:52.850830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.001870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.010522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d4767468-2616-4c6e-bc08-b7f086666474 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.173595 Jun 15 00:42:53.011173 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 195/356] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:52 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:53.267084 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:53.267598 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:53.269369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:53.274656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.275099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.275848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.276301 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.409600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.417478 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.418983 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.420171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1fff262f-31b0-4a7c-95b4-26e051aefee8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.157868 Jun 15 00:42:53.420772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 162/357] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:53 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:53.519345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:53.519345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:53.523971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.524547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.525205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.525665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.658961 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:53.659561 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:53.664281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.665886 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.666570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.667060 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:53.667486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:53.672103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-88f3660d-a3e1-4cf8-8ee5-a17c79ba0cda tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.159176 Jun 15 00:42:53.672674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 196/358] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:53 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:53.809975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:53.818272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2ade3b46-a77f-4a44-a8dc-63be2e1a909d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1504 microversion: 2.1 time: 0.163652 Jun 15 00:42:53.818928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 163/359] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:53 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:54.027339 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:54.027977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:54.034280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.034713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.035466 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.035892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.171052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:54.178992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4a0f2969-1187-4dd6-92ed-59c488e7ebdb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.155528 Jun 15 00:42:54.179550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 197/360] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:54 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:54.441691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:54.442295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:54.448807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.449255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.450006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.450434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.589854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:54.598831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:54.600364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:54.601536 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ec104687-cb8f-4790-a205-457242546703 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.166746 Jun 15 00:42:54.602101 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 164/361] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:54 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:54.688911 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:54.689530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:54.696569 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.697009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.697773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.698199 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.835350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:54.836067 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:54.843023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.844426 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.845269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:54.845899 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:54.874275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:54.880985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fe9462e8-1b6b-4de3-b8d6-686e639c31ca tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.195918 Jun 15 00:42:54.882269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 198/362] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:54 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:54.992637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-e6cde1c6-c2c9-48e9-9438-2a8d0818a727 req-24736429-8a08-4d9d-88b8-c5739e50dadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:55.007340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:55.007340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-83d1c2ca-e57e-438e-b671-e99eb4d48ace tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1504 microversion: 2.1 time: 0.174237 Jun 15 00:42:55.007590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e6cde1c6-c2c9-48e9-9438-2a8d0818a727 req-24736429-8a08-4d9d-88b8-c5739e50dadc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.007590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e6cde1c6-c2c9-48e9-9438-2a8d0818a727 req-24736429-8a08-4d9d-88b8-c5739e50dadc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.007837 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 165/363] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:54 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:55.026228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-e6cde1c6-c2c9-48e9-9438-2a8d0818a727 req-24736429-8a08-4d9d-88b8-c5739e50dadc service nova] Creating event network-changed:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:42:55.034720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-e6cde1c6-c2c9-48e9-9438-2a8d0818a727 req-24736429-8a08-4d9d-88b8-c5739e50dadc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052866 Jun 15 00:42:55.035974 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 199/364] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:42:55.196424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:55.197295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:55.205265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.205722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.206695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.207289 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.365306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:55.372859 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c07829f0-d041-4a26-9a2d-2b4697430ba3 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.180286 Jun 15 00:42:55.373567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 166/365] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:55 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:55.622127 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:55.622732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:55.632309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:55.636920 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.637360 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.640856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.640856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.861790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:55.874309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:55.876238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:55.877691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9fc12196-07a3-4e59-ae39-d07d69d3b47f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.260293 Jun 15 00:42:55.878427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 200/366] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:55 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:55.899182 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:55.899894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:55.906484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.907023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:55.907842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:55.908477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.023325 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:56.024204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:56.029732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.032244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.033473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.034102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.034516 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.054776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.060196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:56.079424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8e282399-8d1b-4d9d-bbb5-00f8beee588f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.173689 Jun 15 00:42:56.079535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.079535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.079535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lazy-loading 'fault' on Instance uuid 085b264e-07a7-4bc7-959e-f670fc92830c {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:42:56.080754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 167/367] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:55 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:56.118350 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:56.126178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-276e88a2-873d-484d-bd88-cc8eabb85979 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1304 microversion: 2.1 time: 0.107352 Jun 15 00:42:56.126679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 201/368] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:56 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:56.390158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:56.390924 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:56.396875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.397320 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.398065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.398521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.419849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.538412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:56.545533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ebaed4d6-6afd-407f-80d1-ad6a68523c10 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.159417 Jun 15 00:42:56.546091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 168/369] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:56 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:56.898210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:56.898943 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:56.901259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=24 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.908930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.909434 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:56.910496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:56.911085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.047021 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.051639 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-2b806401-2be9-4a57-8c65-6e6bd5406bee req-e5a1ba41-e15e-4edf-9afc-629fa83dcf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "085b264e-07a7-4bc7-959e-f670fc92830c", "name": "network-vif-deleted", "tag": "03be6cf2-ca74-4f95-bd2f-221dcc1faf2e"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:57.056272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.057786 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.058940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-356ed223-8c8e-46be-a034-04d02c76073a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.166082 Jun 15 00:42:57.067244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 202/370] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:56 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:57.067405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-2b806401-2be9-4a57-8c65-6e6bd5406bee req-e5a1ba41-e15e-4edf-9afc-629fa83dcf19 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.067405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-2b806401-2be9-4a57-8c65-6e6bd5406bee req-e5a1ba41-e15e-4edf-9afc-629fa83dcf19 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.072306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-2b806401-2be9-4a57-8c65-6e6bd5406bee req-e5a1ba41-e15e-4edf-9afc-629fa83dcf19 service nova] Creating event network-vif-deleted:03be6cf2-ca74-4f95-bd2f-221dcc1faf2e for instance 085b264e-07a7-4bc7-959e-f670fc92830c on hv-cinder-84517 Jun 15 00:42:57.077111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-2b806401-2be9-4a57-8c65-6e6bd5406bee req-e5a1ba41-e15e-4edf-9afc-629fa83dcf19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029045 Jun 15 00:42:57.078207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 169/371] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:42:57.086923 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:57.087527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:57.094512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.094952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.095701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.096153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.147446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:57.148348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:57.154712 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.155450 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.157014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.157440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.189790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.190224 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.190666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lazy-loading 'fault' on Instance uuid 085b264e-07a7-4bc7-959e-f670fc92830c {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:42:57.248912 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.257649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-05653be8-f600-4948-b876-a5dc7bb12033 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 200 len: 1304 microversion: 2.1 time: 0.114361 Jun 15 00:42:57.258432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 170/372] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:57 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:57.268477 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.276350 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f0f9d6e-f830-425a-af50-156b9d0ce7b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.193626 Jun 15 00:42:57.277089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 203/373] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:57 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:57.563463 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:57.564093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:57.570102 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.570546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.571328 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:57.571774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:57.699439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:57.706836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cbaa6e9a-eb59-4551-bf27-f6255740c484 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.148177 Jun 15 00:42:57.707476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 171/374] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:57 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:58.076662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:58.077258 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:58.083789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.084333 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.085088 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.085517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.229873 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:58.238667 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:58.240337 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:58.241484 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-77d29fa6-e39e-49a9-a126-2811da4ba355 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.168720 Jun 15 00:42:58.242024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 204/375] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:58 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:58.274455 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:58.275067 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: 085b264e-07a7-4bc7-959e-f670fc92830c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:58.281739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.282194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.282950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.283384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.292734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:58.293335 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:58.296928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] HTTP exception thrown: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Request method failure captured: Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c HTTP/1.1 Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSrz8mJeBtg_l_1bb1nIN-xAYSoOfA0SEjNt09saTsKDNf23xpwhsezGnuFyCZ0vN3TfcWpTKG2WnIU76f0d3ewFBhOruLQqtdPMgxsF9tpfQ3WMLw7_rJyAg_uyQsR8EGv79E0TvD5kl9Hpbu8IVEEG8JY-BL2RvOWK6zPD_VJnMAc Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: a0645668bf03499f97a2a54cbe75e3fe Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesActionsTest-1712238706 Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:42:58.299099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a0645668bf03499f97a2a54cbe75e3fe", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a0645668bf03499f97a2a54cbe75e3fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a0645668bf03499f97a2a54cbe75e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a0645668bf03499f97a2a54cbe75e3fe"}]}] Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesActionsTest-1712238706 Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: a0645668bf03499f97a2a54cbe75e3fe Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesActionsTest-1712238706 Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesActionsTest-1712238706-project Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: b7de51e3989248088b608a5d50400064 Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesActionsTest-1712238706-project Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. Jun 15 00:42:58.300624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '085b264e-07a7-4bc7-959e-f670fc92830c'} Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:42:58.304564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. Jun 15 00:42:58.305836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:42:58.306896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Returning 404 to user: Instance 085b264e-07a7-4bc7-959e-f670fc92830c could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:42:58.306983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.306983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.307163 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ec6706d6-1d18-4331-ba1b-0c0dbbdbfd3c tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c" status: 404 len: 111 microversion: 2.1 time: 0.029963 Jun 15 00:42:58.307250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.307335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 172/376] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:58 2022] GET /compute/v2.1/servers/085b264e-07a7-4bc7-959e-f670fc92830c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:42:58.307419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.402286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-351314759", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "networks": [{"uuid": "653b6765-3e05-4b90-a296-9901f0b92538"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:42:58.431767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:58.439191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-720d0551-e735-41e5-9359-12292e9d0cb9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.150149 Jun 15 00:42:58.439931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 205/377] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:58 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:58.455125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] validate_networks() for [('653b6765-3e05-4b90-a296-9901f0b92538', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:42:58.724264 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:58.725011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:58.731937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.732484 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.733331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.733841 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.836927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:42:58.837611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:42:58.838193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:42:58.838703 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:42:58.839346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:42:58.848364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.848949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.849852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:58.850386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:58.868197 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Getting quotas for project a0645668bf03499f97a2a54cbe75e3fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:42:58.872830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Getting quotas for user b7de51e3989248088b608a5d50400064 and project a0645668bf03499f97a2a54cbe75e3fe. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:42:58.885029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:58.885581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:42:58.888321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:42:58.894124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2fe08e8-3147-4833-a87f-ebd90c367393 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.173760 Jun 15 00:42:58.894794 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 206/378] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:58 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:59.004187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-81d88d8a-bf49-4e16-876f-b46f7b7573f4 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605752 Jun 15 00:42:59.004898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 173/379] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:42:59.016585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1d4d6bf3-bbe1-45b3-a375-69ff3b2848e0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:59.021860 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1d4d6bf3-bbe1-45b3-a375-69ff3b2848e0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:59.080789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1d4d6bf3-bbe1-45b3-a375-69ff3b2848e0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:59.089072 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1d4d6bf3-bbe1-45b3-a375-69ff3b2848e0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1213 microversion: 2.1 time: 0.077890 Jun 15 00:42:59.090368 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 207/380] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:59 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:42:59.259239 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:59.259838 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:59.266475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.266916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:59.267733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.268475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:59.403865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:59.412892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:59.414393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:59.417562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-907dafd3-c338-4858-8a64-7ebcaa987ea1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1746 microversion: 2.20 time: 0.160694 Jun 15 00:42:59.417562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 174/381] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:42:59 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:42:59.455472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:59.456091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:59.462881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.463330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:59.464177 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.464646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:59.599382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:42:59.606718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d972761b-a158-4332-9218-9a99a72e156d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.155199 Jun 15 00:42:59.607279 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 208/382] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:59 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:42:59.910853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:42:59.911506 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:42:59.917306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.917748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:42:59.918495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:42:59.918958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.061113 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.069613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f3de80db-be12-4fa4-a2fa-3fc6cc4c5213 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.162497 Jun 15 00:43:00.070187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 175/383] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:42:59 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:00.106608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:00.107216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:00.114928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.115441 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.116417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.119834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.177567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.184843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e1573401-69fc-4eca-afa1-3ec3bab6cddc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1217 microversion: 2.1 time: 0.082207 Jun 15 00:43:00.185390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 209/384] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:00 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:00.434416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:00.434923 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:00.441998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.442475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.443243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.443682 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.584502 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.592972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.595010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.596206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8e84671e-21da-4a56-b04f-e40f6d47a34d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1746 microversion: 2.20 time: 0.165863 Jun 15 00:43:00.596756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 176/385] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:00 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:00.622349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:00.622942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:00.629220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.629657 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.630397 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:00.630819 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:00.761551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:00.769537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c16b6577-1f29-4d5c-bdc7-0efcb76e7cea tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.150964 Jun 15 00:43:00.770099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 210/386] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:00 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:01.086447 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:01.087056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:01.093127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.093579 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.094333 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.094767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.202044 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:01.202637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:01.213058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.213529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.214290 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.214717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.224260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.231672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-82dbf8ea-ec90-4fe7-9123-69446fa79914 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.149015 Jun 15 00:43:01.232766 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 177/387] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:01 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:01.276322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.283600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1aa18e0-5f61-46a2-a79b-13377d96eca5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1265 microversion: 2.1 time: 0.085365 Jun 15 00:43:01.284248 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 211/388] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:01 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:01.614897 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:01.615505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:01.621865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.622375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.623128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.623557 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.750588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.758341 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.759838 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.761294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2381acf0-a874-4df7-b1f3-070095b4327f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1746 microversion: 2.20 time: 0.150325 Jun 15 00:43:01.761843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 178/389] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:01 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:01.785810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:01.786409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:01.792338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.792779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.793514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:01.793936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:01.921556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:01.929827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9f95de66-83e9-4050-bfc2-e779cdea6c74 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.147757 Jun 15 00:43:01.930377 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 212/390] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:01 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:02.248517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:02.249116 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:02.255710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.256187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.256972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.257408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.301001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:02.301623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:02.308038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.308480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.309230 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.309653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.379768 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:02.387250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-768b66bb-3a50-4a26-9c04-32e738219279 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1265 microversion: 2.1 time: 0.090552 Jun 15 00:43:02.387815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 213/391] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:02 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:02.409614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:02.417109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b217da3f-e3c5-4e77-ac7e-c9b5a2eaf228 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.172347 Jun 15 00:43:02.417726 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 179/392] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:02 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:02.778608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:02.780625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:02.785805 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.786250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.786996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.787475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.912276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:02.920180 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:02.921734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:02.922904 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9f798fa3-8386-4e31-9f20-d3dcce89bf51 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1746 microversion: 2.20 time: 0.148297 Jun 15 00:43:02.923451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 214/393] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:02 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:02.946410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:02.947000 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:02.953881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.954315 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:02.955055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:02.955479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.080388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:03.087750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-78a3c2ee-9b80-4c1a-994c-8f164654e310 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.145251 Jun 15 00:43:03.088348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 180/394] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:02 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:03.404239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:03.404835 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:03.411547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.412010 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.412754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.413178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.434575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:03.435168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:03.441686 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.442129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.442885 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.443309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.476121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:03.483622 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6d513c53-7a54-4ede-9749-815d04fabfc9 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1265 microversion: 2.1 time: 0.083102 Jun 15 00:43:03.484256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 215/395] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:03 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:03.568150 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:03.575357 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c81eccfd-cc72-4515-b6dc-79b6019d89bd tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.144659 Jun 15 00:43:03.575927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 181/396] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:03 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:03.940998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:03.941595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:03.947624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.948114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:03.948868 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:03.954056 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.077341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.087487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.089274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.090437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-148afdcd-abb5-498a-9f6d-c766b0f98384 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1746 microversion: 2.20 time: 0.153988 Jun 15 00:43:04.090994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 216/397] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:03 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:04.105951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:04.106529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:04.113563 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.113990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.114820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.115316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.248690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.255995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a03f05c0-90f1-4459-9bd2-50c64197dc65 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.154259 Jun 15 00:43:04.256580 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 182/398] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:04 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:04.500924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:04.502309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:04.508305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.508748 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.509494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.509951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.593287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:04.594884 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:04.596429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.603439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.603897 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.604662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3c75e1d2-a751-4101-b338-09fdc993e3ed tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1273 microversion: 2.1 time: 0.107748 Jun 15 00:43:04.604804 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.605520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.617002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 217/399] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:04 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:04.617002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-e4030783-f474-4ee3-bb59-d84e647e0082 req-56eedf69-23e0-45c4-8853-757295cdd3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "name": "network-vif-plugged", "status": "completed", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:04.632320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e4030783-f474-4ee3-bb59-d84e647e0082 req-56eedf69-23e0-45c4-8853-757295cdd3bf service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:04.632805 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e4030783-f474-4ee3-bb59-d84e647e0082 req-56eedf69-23e0-45c4-8853-757295cdd3bf service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:04.654387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-e4030783-f474-4ee3-bb59-d84e647e0082 req-56eedf69-23e0-45c4-8853-757295cdd3bf service nova] Creating event network-vif-plugged:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:43:04.665271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-e4030783-f474-4ee3-bb59-d84e647e0082 req-56eedf69-23e0-45c4-8853-757295cdd3bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055589 Jun 15 00:43:04.666060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 218/400] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:04.773957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:04.786848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d2a37b66-f8a4-4680-8097-cb1ca60ae20b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.196149 Jun 15 00:43:04.793699 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 183/401] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:04 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:05.109883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:05.110579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:05.126885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.128819 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.133495 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.134154 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.151211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:05.273106 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:05.273595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.273904 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:05.280386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.280974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.281857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.282392 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.282773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.284814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.286009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b754278d-9f09-4a35-a705-382312fae54a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.180308 Jun 15 00:43:05.303479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 219/402] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:05 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:05.445153 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.452941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-04927884-1056-4d04-a96f-d9591c4237b7 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.184092 Jun 15 00:43:05.453611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 184/403] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:05 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:05.624365 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:05.625039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:05.632975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.635172 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.635172 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.635824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.773080 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.782548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c40876a0-fd94-4703-beee-e1c086e6adc6 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.161876 Jun 15 00:43:05.783814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 220/404] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:05 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:05.803137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:05.805806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:05.810364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.811026 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.811852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:05.812519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:05.969810 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:05.979315 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-87be2d66-a9d5-462a-b74b-28ecaba6e19a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.179815 Jun 15 00:43:05.979922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 185/405] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:05 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:06.310588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:06.311194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:06.319925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.320763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.321722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.323180 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.470753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:06.472219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:06.479557 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.482869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.485314 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.486887 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.626018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:06.642934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:06.644811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:06.646248 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0a817267-b681-4825-9301-dbda2b9704a6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.339559 Jun 15 00:43:06.657436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 221/406] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:06 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:06.683340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5f0e99e2-46f9-41c7-831a-0bd9a5ba17eb req-c8143b0d-842f-47d6-b39f-3966a5979bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "name": "network-vif-plugged", "status": "completed", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:06.694328 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5f0e99e2-46f9-41c7-831a-0bd9a5ba17eb req-c8143b0d-842f-47d6-b39f-3966a5979bcd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.697402 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5f0e99e2-46f9-41c7-831a-0bd9a5ba17eb req-c8143b0d-842f-47d6-b39f-3966a5979bcd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.715599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5f0e99e2-46f9-41c7-831a-0bd9a5ba17eb req-c8143b0d-842f-47d6-b39f-3966a5979bcd service nova] Creating event network-vif-plugged:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:43:06.723307 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5f0e99e2-46f9-41c7-831a-0bd9a5ba17eb req-c8143b0d-842f-47d6-b39f-3966a5979bcd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044417 Jun 15 00:43:06.725011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 222/407] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:06.751382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:06.754821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:06.759938 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f08a96ba-4b6c-40e8-b42c-1083cd54f8ec tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.294996 Jun 15 00:43:06.771700 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 186/408] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:06 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:06.803980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-2da1e5da-7263-44e8-a513-e4331c637a1d req-1cd479af-b486-4039-88e3-fd9973f8f131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fb0633-4b35-4b16-9dd8-d421a9968d4d", "tag": "9f97ef99-7953-4d7c-98e7-bf4d991722c3"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:06.813691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:06.813691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:06.822122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.823585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2da1e5da-7263-44e8-a513-e4331c637a1d req-1cd479af-b486-4039-88e3-fd9973f8f131 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.824669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.825546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:06.826056 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2da1e5da-7263-44e8-a513-e4331c637a1d req-1cd479af-b486-4039-88e3-fd9973f8f131 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.827260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:06.860217 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-2da1e5da-7263-44e8-a513-e4331c637a1d req-1cd479af-b486-4039-88e3-fd9973f8f131 service nova] Creating event network-changed:9f97ef99-7953-4d7c-98e7-bf4d991722c3 for instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d on hv-cinder-84517 Jun 15 00:43:06.865039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-2da1e5da-7263-44e8-a513-e4331c637a1d req-1cd479af-b486-4039-88e3-fd9973f8f131 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072937 Jun 15 00:43:06.865626 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 223/409] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:07.002620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:07.003303 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:07.038587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.044867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.047522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.048161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.084921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:07.097129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c694c4ed-7256-4ad3-9775-63ed8e6d3b52 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.298788 Jun 15 00:43:07.097811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 187/410] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:06 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:07.282138 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:07.293836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-26c0beed-e7d5-4891-b5a8-171d6ddd7397 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1371 microversion: 2.1 time: 0.295663 Jun 15 00:43:07.295994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 224/411] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:06 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:07.665179 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:07.665837 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:07.678967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.681604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.686516 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.691858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.778482 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:07.779270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:07.808318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.809054 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.809830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:07.810265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:07.992508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.012554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.014269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.016259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-261a92bb-06ad-46df-bb00-f5c135265ed4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.355101 Jun 15 00:43:08.016975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 188/412] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:07 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:08.083057 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.092133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3b3f9f58-4468-4122-8180-70d5c1a2553b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.317406 Jun 15 00:43:08.102650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 225/413] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:07 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:08.122907 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:08.122907 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:08.129058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.129632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.130489 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.131095 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.319985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:08.321558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:08.328603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.329066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.329948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.330385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.434132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.443879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c6c079bb-ea52-4762-86e8-37788b3019a5 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.329030 Jun 15 00:43:08.445103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 189/414] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:08 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:08.550860 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:08.562743 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-be04a732-9fc6-477b-912c-2780b58a5378 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1565 microversion: 2.1 time: 0.246788 Jun 15 00:43:08.563356 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 226/415] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:08 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1565 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:08.580484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:08.581483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:08.591255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.592051 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.594154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.596640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.713398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e2d4c39-479b-4478-a552-719d0081964f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137962 Jun 15 00:43:08.715738 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 190/416] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:43:08 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:08.745669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-48a1a4f7-417d-470a-a057-570d1fab5e9a req-ac4568e8-4eec-45fc-93ba-df82a8b74b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "name": "network-vif-plugged", "status": "completed", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:08.759799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-48a1a4f7-417d-470a-a057-570d1fab5e9a req-ac4568e8-4eec-45fc-93ba-df82a8b74b73 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:08.760687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-48a1a4f7-417d-470a-a057-570d1fab5e9a req-ac4568e8-4eec-45fc-93ba-df82a8b74b73 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:08.772853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-48a1a4f7-417d-470a-a057-570d1fab5e9a req-ac4568e8-4eec-45fc-93ba-df82a8b74b73 service nova] Creating event network-vif-plugged:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:43:08.779895 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-48a1a4f7-417d-470a-a057-570d1fab5e9a req-ac4568e8-4eec-45fc-93ba-df82a8b74b73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043998 Jun 15 00:43:08.781678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 227/417] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:09.033517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:09.034322 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:09.038106 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:09.039074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:09.046737 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.048269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:09.050033 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.050953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:09.106780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:09.117041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:09.117645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:09.151163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.151609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:09.152418 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.152841 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:09.733046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:09.736970 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:09.747692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-095404dd-298b-43a1-a43a-4a07a504e740 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.636683 Jun 15 00:43:09.747692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 228/418] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:09 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:09.747692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:09.748630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:09.748892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:09.750746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:09.752531 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dda95f36-889f-4a7b-b3cf-fb16f5f76c7f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.720218 Jun 15 00:43:09.753166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 191/419] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:09 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:09.756134 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.756643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:09.757458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:09.757955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:10.026695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:10.038475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-acafa101-8e54-4d47-ad5c-4f99393f1ca0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.294759 Jun 15 00:43:10.039119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 229/420] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:09 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:10.425448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-91ee1512-0676-47f6-98ed-cd6245f2aaf0 req-0d45005c-f4c7-4616-b485-c0471abcbc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:10.445462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-91ee1512-0676-47f6-98ed-cd6245f2aaf0 req-0d45005c-f4c7-4616-b485-c0471abcbc3e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:10.448399 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-91ee1512-0676-47f6-98ed-cd6245f2aaf0 req-0d45005c-f4c7-4616-b485-c0471abcbc3e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:10.463056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-91ee1512-0676-47f6-98ed-cd6245f2aaf0 req-0d45005c-f4c7-4616-b485-c0471abcbc3e service nova] Creating event network-changed:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:43:10.468508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-91ee1512-0676-47f6-98ed-cd6245f2aaf0 req-0d45005c-f4c7-4616-b485-c0471abcbc3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048880 Jun 15 00:43:10.469352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 192/421] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:10.772808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:10.775591 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:10.776599 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:10.777387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:10.793207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:10.795369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:10.798757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:10.798757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:10.799285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:10.800011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:10.800996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:10.801590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:11.067731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:11.070866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:11.080977 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:11.082293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-61ea227c-1cb3-42d6-9ec4-6f1bfc22f1a8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.318994 Jun 15 00:43:11.083583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:11.083861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 230/422] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:10 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:11.085274 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1de1fcaa-e9a2-4990-9d04-1163f1b980d1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.317954 Jun 15 00:43:11.088529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:11.089440 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:11.092354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 193/423] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:10 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:11.099810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:11.100488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:11.101554 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:11.102137 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:11.252754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:11.261237 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ade3588a-b427-490c-9207-5eab52837b7e tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.176274 Jun 15 00:43:11.271139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 231/424] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:11 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:12.101578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:12.102940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:12.103842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:12.104355 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:12.111779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.112560 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.113550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.114195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.114570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.115011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.115767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.116209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.317293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:12.326782 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:12.331233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:12.336420 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ceaf9322-d658-4e3d-9034-e01b49f35bd3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.236446 Jun 15 00:43:12.337221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 232/425] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:12 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:12.341784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:12.342566 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:12.353026 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:12.353637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.354110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.354878 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:12.355362 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:12.362537 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-170118c9-ecb0-47ff-a3bb-72c57429ca48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.266102 Jun 15 00:43:12.364121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 194/426] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:12 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:12.514726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:12.534487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5dacc01b-0dc0-482e-8dd1-7ce9c9ca06fc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.196051 Jun 15 00:43:12.543927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 233/427] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:12 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:13.355812 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:13.356664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:13.371334 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.372199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.373156 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.373848 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.380910 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:13.381687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:13.392579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.394573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.396282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.397461 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.605447 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:13.616393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:13.618455 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:13.620432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cedea22c-5015-4c46-b8f3-f41dcf4df5b5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.269280 Jun 15 00:43:13.632157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 195/428] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:13 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:13.632157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:13.632157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:13.634219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.634677 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.635700 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:13.636174 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:13.642769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:13.651895 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4eb13943-d908-48df-9b7c-8e9737ac4d40 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.276990 Jun 15 00:43:13.653755 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 234/429] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:13 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:13.781245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:13.791004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-77ac611e-f92b-4ab9-9dd6-817fd3cfe201 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.168624 Jun 15 00:43:13.791807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 196/430] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:13 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:14.640537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:14.641398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:14.651272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.656189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:14.657922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.659529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:14.670819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:14.671501 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:14.678424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.678868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:14.679656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.688293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:14.931763 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:14.939672 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:14.949183 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fe458320-7ab3-4d85-accd-ba884833a08e tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1259 microversion: 2.1 time: 0.282366 Jun 15 00:43:14.950227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:14.950371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 197/431] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:14 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:14.952099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:14.953453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-55f14b7a-56e6-4f13-9c67-d01161cd377d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.317199 Jun 15 00:43:14.954851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 235/432] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:14 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:14.961949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:14.962613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:14.970095 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.970590 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:14.971368 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:14.971802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:15.114777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:15.124556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9822e910-75ab-4fa6-b233-b946d8f15e88 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.172558 Jun 15 00:43:15.134988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 198/433] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:14 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:15.967062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:15.972059 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:15.974068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:15.974678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:15.974778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:15.975082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:15.976146 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:15.976643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:15.988272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:15.988743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:15.989553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:15.989985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.254878 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.264791 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.265788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.267443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.268748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dbd96315-cfb6-4c1c-81a3-69801049f277 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.299422 Jun 15 00:43:16.269332 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 199/434] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:15 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:16.276956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4638145c-37e2-4557-bf5a-c828c2501317 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1444 microversion: 2.1 time: 0.309886 Jun 15 00:43:16.277621 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 236/435] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:15 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1444 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:16.286326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:16.286326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:16.286326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:16.289699 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:16.290296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.291551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:16.292553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.295544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:16.296168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:16.303190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:16.303629 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.304418 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:16.304843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.499183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.510188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:16.510595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-688c0426-7385-463a-af5e-ddfb67c9c315 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1444 microversion: 2.1 time: 0.215084 Jun 15 00:43:16.510595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 237/436] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:16 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1444 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:16.513203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f33b5872-ccf8-4be2-92b7-9052b915a880 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.242847 Jun 15 00:43:16.513753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 200/437] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:16 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:16.719840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5e41bcce-85f4-445b-8cf4-1feb3991599c req-233a7cb3-cf13-4fa4-8cac-20146e228abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fb0633-4b35-4b16-9dd8-d421a9968d4d", "name": "network-vif-plugged", "status": "completed", "tag": "9f97ef99-7953-4d7c-98e7-bf4d991722c3"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:16.735188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5e41bcce-85f4-445b-8cf4-1feb3991599c req-233a7cb3-cf13-4fa4-8cac-20146e228abd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:16.735847 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5e41bcce-85f4-445b-8cf4-1feb3991599c req-233a7cb3-cf13-4fa4-8cac-20146e228abd service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:16.738979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:16.754647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5e41bcce-85f4-445b-8cf4-1feb3991599c req-233a7cb3-cf13-4fa4-8cac-20146e228abd service nova] Creating event network-vif-plugged:9f97ef99-7953-4d7c-98e7-bf4d991722c3 for instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d on hv-cinder-84517 Jun 15 00:43:16.760999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5e41bcce-85f4-445b-8cf4-1feb3991599c req-233a7cb3-cf13-4fa4-8cac-20146e228abd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047387 Jun 15 00:43:16.761873 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 238/438] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:17.287091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:17.287743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:17.294840 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:17.295287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:17.296093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:17.296530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:17.536436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:17.536436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:17.537273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:17.540633 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:17.541586 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:17.542000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:17.542432 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:17.544672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:17.546164 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:17.548035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e83745c-e5d3-4f64-bae4-304339fe405b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.264588 Jun 15 00:43:17.548606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 201/439] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:17 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:17.778506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:17.787001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8765a59c-8511-4847-8332-8847cabfb28a tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.260060 Jun 15 00:43:17.787837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 239/440] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:17 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:18.568716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:18.569316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:18.576206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:18.576652 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:18.577410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:18.577839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:18.804314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:18.805093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:18.812041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:18.812569 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:18.813951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:18.814377 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:19.025432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:19.033975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:19.035468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:19.036640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a5de3d40-4bb2-42a1-9cbb-f25d67ee1cb0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.471929 Jun 15 00:43:19.038142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 202/441] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:18 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:19.072227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:19.080119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5fb8c5bb-b752-4334-9dfd-11f52e5cd96b tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.279516 Jun 15 00:43:19.089110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 240/442] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:18 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:19.259847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d2f1b7da-64c0-4bff-baf8-a584d48d4248 req-676c7a83-c8c8-46a4-93ed-a6e0fdf19aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:19.268217 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d2f1b7da-64c0-4bff-baf8-a584d48d4248 req-676c7a83-c8c8-46a4-93ed-a6e0fdf19aa5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:19.268713 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d2f1b7da-64c0-4bff-baf8-a584d48d4248 req-676c7a83-c8c8-46a4-93ed-a6e0fdf19aa5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:19.279843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d2f1b7da-64c0-4bff-baf8-a584d48d4248 req-676c7a83-c8c8-46a4-93ed-a6e0fdf19aa5 service nova] Creating event network-changed:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:43:19.285449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d2f1b7da-64c0-4bff-baf8-a584d48d4248 req-676c7a83-c8c8-46a4-93ed-a6e0fdf19aa5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029207 Jun 15 00:43:19.286037 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 203/443] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:20.054587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:20.055198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:20.061722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:20.062169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:20.063415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:20.063879 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:20.097683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:20.098458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:20.105062 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:20.105644 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:20.106516 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:20.107053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:20.248679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:20.257245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:20.258835 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:20.260026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7fe4cc0c-4c5a-42b5-affe-95064413c8d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.209341 Jun 15 00:43:20.260836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 241/444] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:20 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:20.277614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:20.284956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-169b476f-c94d-4606-9080-88a50ef749b0 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.192044 Jun 15 00:43:20.285504 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 204/445] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:20 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:21.278684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:21.279183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:21.285908 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:21.286343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:21.287084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:21.287506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:21.301430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:21.302317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:21.308851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:21.318410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:21.318410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:21.318410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:21.318410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:21.502433 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:21.506542 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:21.510120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a118026-342a-4128-bfb5-d0bbd470a11d tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1313 microversion: 2.1 time: 0.212530 Jun 15 00:43:21.510961 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 205/446] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:21 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:21.515276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:21.517390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:21.518541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-500d689f-1ed5-4cfe-91f1-6f00c4d2aed3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1741 microversion: 2.20 time: 0.243983 Jun 15 00:43:21.519086 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 242/447] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:21 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:22.532546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:22.533280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:22.540430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:22.540882 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:22.541646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:22.542072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:22.542881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:22.543481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:22.552259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:22.553100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:22.554272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:22.554904 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:22.755487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:22.758590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:22.763529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5d588d1c-589d-4302-a373-5d0afd2650dc tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1497 microversion: 2.1 time: 0.239450 Jun 15 00:43:22.764288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 206/448] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:22 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:22.767557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:22.769129 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:22.770266 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8b05ddcc-6d8e-4a9f-980c-7bf69ea71bcb tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1723 microversion: 2.20 time: 0.231593 Jun 15 00:43:22.770803 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 243/449] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:22 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:23.688125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:23.688125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:23.693369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:23.693831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:23.694589 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:23.695023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:23.721188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:43:23.789273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:23.790253 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:23.797604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:23.798166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:23.799232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:23.799785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:24.010428 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:24.018557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:24.020077 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:24.025170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-45f55082-d450-4c84-b0ab-f77e8b669db4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1723 microversion: 2.20 time: 0.235945 Jun 15 00:43:24.025170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 244/450] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:23 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:24.088276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-576ab4f5-e1d6-46cd-8a1d-44c921827081 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 204 len: 0 microversion: 2.1 time: 0.405956 Jun 15 00:43:24.088863 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 207/451] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:43:23 2022] DELETE /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:43:24.096885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:24.100046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:24.103475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:24.103931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:24.104696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:24.105125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:24.229392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:24.237233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ded0fd5-97f1-44d7-b5b0-e9dd78013463 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1503 microversion: 2.1 time: 0.144205 Jun 15 00:43:24.237789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 245/452] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:24 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:25.039769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:25.040507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:25.046916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:25.047457 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:25.048234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:25.048657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:25.186459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:25.195060 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:25.196609 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:25.197788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-265dd28c-10d3-4bea-9eff-aa63d8f35fea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1723 microversion: 2.20 time: 0.162222 Jun 15 00:43:25.198365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 208/453] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:25 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:25.254972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:25.255606 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:25.262284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:25.262720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:25.263469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:25.263898 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:25.388616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:25.396151 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-209230a9-d666-4299-b5aa-d45ec7abde25 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1503 microversion: 2.1 time: 0.145095 Jun 15 00:43:25.396714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 246/454] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:25 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:26.216344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:26.216922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:26.224009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:26.224507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:26.225203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:26.225631 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:26.351741 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:26.359612 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:26.361139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:26.362284 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d82bbc44-e5c4-4bbf-9b53-2c1158a925b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1723 microversion: 2.20 time: 0.149787 Jun 15 00:43:26.362835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 209/455] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:26 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:26.414851 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:26.415229 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:26.417429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=98 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:26.422182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:26.425438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:26.425438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:26.425438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:26.523119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-ce4c73bc-2c08-4e7b-858e-ffba6833d127 req-701d29ee-c1be-4619-811f-718420c71d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "name": "network-vif-unplugged", "status": "completed", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:26.533950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ce4c73bc-2c08-4e7b-858e-ffba6833d127 req-701d29ee-c1be-4619-811f-718420c71d4d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:26.534388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ce4c73bc-2c08-4e7b-858e-ffba6833d127 req-701d29ee-c1be-4619-811f-718420c71d4d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:26.545167 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-ce4c73bc-2c08-4e7b-858e-ffba6833d127 req-701d29ee-c1be-4619-811f-718420c71d4d service nova] Creating event network-vif-unplugged:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:43:26.549906 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-ce4c73bc-2c08-4e7b-858e-ffba6833d127 req-701d29ee-c1be-4619-811f-718420c71d4d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030701 Jun 15 00:43:26.550557 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 210/456] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:26.557308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:26.565160 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3ec5e62b-8fb6-4155-a39e-35e80b6e04a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1503 microversion: 2.1 time: 0.154709 Jun 15 00:43:26.565712 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 247/457] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:26 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:27.382146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:27.382839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:27.389622 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:27.390072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:27.390828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:27.391881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:27.530995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:27.538793 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:27.540308 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:27.541623 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d0567f6a-820b-414e-ab66-ae3230269956 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1723 microversion: 2.20 time: 0.164167 Jun 15 00:43:27.542499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 211/458] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:27 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:27.585634 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:27.587940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:27.597269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:27.597736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:27.598492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:27.598917 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:27.728388 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:27.738549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ddf5e23e-44be-480d-b7c2-43d6b69be3ce tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1503 microversion: 2.1 time: 0.160455 Jun 15 00:43:27.739123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 248/459] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:27 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:28.401973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-69778333-7238-42c6-98eb-6a7c50bce170 req-1bdaad4a-c780-4daf-997e-57fc735166c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fb0633-4b35-4b16-9dd8-d421a9968d4d", "name": "network-vif-deleted", "tag": "9f97ef99-7953-4d7c-98e7-bf4d991722c3"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:28.411038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-69778333-7238-42c6-98eb-6a7c50bce170 req-1bdaad4a-c780-4daf-997e-57fc735166c3 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.411610 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-69778333-7238-42c6-98eb-6a7c50bce170 req-1bdaad4a-c780-4daf-997e-57fc735166c3 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.422499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-69778333-7238-42c6-98eb-6a7c50bce170 req-1bdaad4a-c780-4daf-997e-57fc735166c3 service nova] Creating event network-vif-deleted:9f97ef99-7953-4d7c-98e7-bf4d991722c3 for instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d on hv-cinder-84517 Jun 15 00:43:28.427382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-69778333-7238-42c6-98eb-6a7c50bce170 req-1bdaad4a-c780-4daf-997e-57fc735166c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029374 Jun 15 00:43:28.427972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 212/460] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:43:28.559247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:28.559927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:28.567855 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.568467 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.569061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.569482 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.701468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:28.709888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:28.711417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:28.712684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bd4cd389-8f9e-4e43-a264-efd2f8eb8794 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1726 microversion: 2.20 time: 0.157339 Jun 15 00:43:28.713922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 249/461] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:28 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:28.746744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06d42985-97ee-4464-be8e-6150c4c9f575"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:28.747891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:28.755005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:28.755509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.755997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.756112 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:28.756763 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.757364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.766918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.767511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.768624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:28.771649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:28.842628 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7de51e3989248088b608a5d50400064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0645668bf03499f97a2a54cbe75e3fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:28.850186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d62c554f-7829-4eb0-9d94-0454528179a8 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 200 len: 1298 microversion: 2.1 time: 0.099535 Jun 15 00:43:28.850751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 250/462] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:28 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:29.755994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-43e1e5f7-0f5a-4af1-9994-3d07681cb735 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.014537 Jun 15 00:43:29.756620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 213/463] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jun 15 00:43:28 2022] POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments => generated 188 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:43:29.866912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:29.867503 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] [instance: e7fb0633-4b35-4b16-9dd8-d421a9968d4d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:29.869439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:29.870079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:29.873970 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:29.874408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:29.875156 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:29.875577 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:29.876748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:29.877194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:29.877950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:29.878383 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:29.888951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] HTTP exception thrown: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Request method failure captured: Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d HTTP/1.1 Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSrz8mJeBtg_l_1bb1nIN-xAYSoOfA0SEjNt09saTsKDNf23xpwhsezGnuFyCZ0vN3TfcWpTKG2WnIU76f0d3ewFBhOruLQqtdPMgxsF9tpfQ3WMLw7_rJyAg_uyQsR8EGv79E0TvD5kl9Hpbu8IVEEG8JY-BL2RvOWK6zPD_VJnMAc Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: a0645668bf03499f97a2a54cbe75e3fe Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesActionsTest-1712238706 Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:43:29.890563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a0645668bf03499f97a2a54cbe75e3fe", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a0645668bf03499f97a2a54cbe75e3fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a0645668bf03499f97a2a54cbe75e3fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a0645668bf03499f97a2a54cbe75e3fe"}]}] Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesActionsTest-1712238706 Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: a0645668bf03499f97a2a54cbe75e3fe Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesActionsTest-1712238706 Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesActionsTest-1712238706-project Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: b7de51e3989248088b608a5d50400064 Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesActionsTest-1712238706-project Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. Jun 15 00:43:29.892722 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'e7fb0633-4b35-4b16-9dd8-d421a9968d4d'} Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:43:29.893512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. Jun 15 00:43:29.894934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:43:29.896224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] Returning 404 to user: Instance e7fb0633-4b35-4b16-9dd8-d421a9968d4d could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:43:29.896224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a4a5c77b-8f3c-45e7-b6b5-7796475ebb79 tempest-VolumesActionsTest-1712238706 tempest-VolumesActionsTest-1712238706-project] 10.222.0.17 "GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d" status: 404 len: 111 microversion: 2.1 time: 0.029091 Jun 15 00:43:29.896224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 251/464] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:29 2022] GET /compute/v2.1/servers/e7fb0633-4b35-4b16-9dd8-d421a9968d4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:43:30.100201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d0d4a6b2-38b6-400d-a794-ad65c518ada9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/action" status: 202 len: 0 microversion: 2.20 time: 0.234535 Jun 15 00:43:30.100807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 214/465] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jun 15 00:43:29 2022] POST /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 00:43:30.108972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:30.109570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:30.115593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:30.116075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:30.116829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:30.117259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:30.247499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:30.256671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:30.258353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:30.259707 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-86659c9a-4220-451d-9054-c8ad21dfe32d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1752 microversion: 2.20 time: 0.154643 Jun 15 00:43:30.260690 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 252/466] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:30 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:31.280237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:31.280851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:31.287408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:31.287850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:31.288628 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:31.289058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:31.418125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:31.426507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:31.428033 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:31.429182 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9f90a71a-623a-40b4-9ebe-906f9b29bc4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1752 microversion: 2.20 time: 0.153365 Jun 15 00:43:31.429733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 215/467] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:31 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:32.447931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:32.448564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:32.455344 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:32.455780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:32.456549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:32.457046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:32.589053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:32.598023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:32.599540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:32.600712 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9c8a683d-b755-45cc-8b59-47aed4530910 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1752 microversion: 2.20 time: 0.156878 Jun 15 00:43:32.601269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 253/468] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:32 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:33.619648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:33.620287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:33.627187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:33.627639 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:33.628421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:33.628854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:33.752972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:33.761460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:33.762940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:33.764099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bce116c2-4eb6-4f47-86f1-542cae9cf129 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1752 microversion: 2.20 time: 0.148350 Jun 15 00:43:33.764649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 216/469] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:33 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:34.782190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:34.782805 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:34.789300 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:34.789741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:34.790478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:34.790899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:34.919167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:34.927416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:34.928916 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:34.930051 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3ed27199-fd40-4aca-a346-847db0461a05 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1754 microversion: 2.20 time: 0.151756 Jun 15 00:43:34.930597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 254/470] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:34 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:35.949022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:35.949559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:35.956257 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:35.956710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:35.957473 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:35.957907 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:36.101515 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:36.105363 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:36.111512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:36.114013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:36.114655 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-83b37a53-d537-45bd-bda4-7d0849474c66 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1754 microversion: 2.20 time: 0.169518 Jun 15 00:43:36.115304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 217/471] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:35 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:36.966403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:36.968158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:36.978159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:36.979227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:36.980682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:36.981600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:37.133244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:37.134517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:37.144036 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lazy-loading 'services' on Instance uuid 902f043a-d22e-41d1-b8f7-166e9d9080ba {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:43:37.144459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:37.145132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:37.146129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:37.146797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:37.202857 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:37.331643 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:37.344817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:37.346625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:37.349066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c237f183-6ad0-4687-a581-e91bdfc912cf tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.218575 Jun 15 00:43:37.349066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 218/472] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:37 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:37.497445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6e6759db-1516-408d-bb08-94931de53e7a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments/c93ff64e-b9cd-4b9e-999f-0f84e1c13950" status: 202 len: 0 microversion: 2.1 time: 0.536842 Jun 15 00:43:37.498294 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 255/473] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:43:36 2022] DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments/c93ff64e-b9cd-4b9e-999f-0f84e1c13950 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:43:38.367614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:38.368303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:38.375558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:38.376868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:38.377940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:38.378536 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:38.543452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:38.557614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:38.560754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:38.567704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d85126db-debd-45ce-bcc3-fb8058de079c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.204693 Jun 15 00:43:38.568611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 219/474] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:38 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:39.588617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:39.590059 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:39.600777 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:39.601491 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:39.602413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:39.603018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:39.741518 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f6feed36-158d-4d00-bfbe-8fb8d65b8ae6 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:39.753656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6feed36-158d-4d00-bfbe-8fb8d65b8ae6 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:39.754162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6feed36-158d-4d00-bfbe-8fb8d65b8ae6 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:39.792999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f6feed36-158d-4d00-bfbe-8fb8d65b8ae6 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Going to try to stop instance {{(pid=124682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 00:43:39.822530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:39.831982 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:39.834449 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:39.836642 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9dee1f27-aad0-4a9c-91c1-05046b059220 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.252852 Jun 15 00:43:39.846545 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 256/475] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:39 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:40.000954 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f6feed36-158d-4d00-bfbe-8fb8d65b8ae6 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action" status: 202 len: 0 microversion: 2.1 time: 0.263248 Jun 15 00:43:40.005912 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 220/476] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:43:39 2022] POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 00:43:40.010630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:40.011405 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:40.021357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:40.022528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:40.023669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:40.024521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:40.358778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:40.382948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bc45cbfa-bf51-4f3a-b3fe-32d0782bbea3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.375641 Jun 15 00:43:40.385554 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 257/477] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:40 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:40.857387 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:40.858218 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:40.866641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:40.871554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:40.872645 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:40.873753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:41.117282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:41.127027 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:41.128738 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:41.130148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0a814a49-cf86-43f0-8a55-2ce93856f6ec tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.279002 Jun 15 00:43:41.130886 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 221/478] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:40 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:41.402973 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:41.406288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:41.411288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:41.411739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:41.412731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:41.413166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:41.581476 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:41.590079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aa4ca4b2-ae81-4a18-a7d9-8f4d4eae8e28 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.191001 Jun 15 00:43:41.590743 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 258/479] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:41 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:42.150372 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:42.150967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:42.166474 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:42.166926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:42.167785 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:42.168683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:42.435564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:42.450614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:42.453165 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:42.457767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-123001aa-3457-4cb1-b36d-42bf75de6c12 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.308970 Jun 15 00:43:42.458469 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 222/480] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:42 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:42.609581 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:42.610764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:42.619475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:42.620233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:42.621288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:42.621992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:42.846955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:42.857789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-98024932-bd41-405b-9191-d6438f88f83e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.251946 Jun 15 00:43:42.858870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 259/481] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:42 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:43.457453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:43:43.465303 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 00:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:43:43.480205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:43.480981 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:43.501506 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:43.502320 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:43.503493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:43.504245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:43.744132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:43.771951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:43.791578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:43.795067 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6bb05401-9c89-463d-be7c-d5a057a4f21e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.318833 Jun 15 00:43:43.810388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 223/482] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:43 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:43.887857 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:43.889734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:43.900974 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:43.902011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:43.903103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:43.904203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:44.134341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:44.163204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6af36184-4168-4a07-9898-986e6f0efabc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.280826 Jun 15 00:43:44.180293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 260/483] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:43 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:44.825014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:44.826463 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:44.833703 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:44.834497 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:44.835520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:44.836259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:45.025689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:45.025689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:45.026012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:45.026012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d716f75e-1c2c-460b-97ba-810f6873eaff tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.185193 Jun 15 00:43:45.026012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 224/484] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:44 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:45.185945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:45.186760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:45.204446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:45.205182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:45.205960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:45.206396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:45.414468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:45.424478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-15f89f87-b362-497c-8c7d-3ca25c830748 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.242167 Jun 15 00:43:45.427149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 261/485] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:45 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:46.054371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:46.054371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:46.054371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:46.054371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:46.055130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:46.055130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:46.324963 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:46.345553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:46.347952 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:46.349410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1e9442f0-e208-4d39-840b-ad6670a0a3f1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.310642 Jun 15 00:43:46.350455 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 225/486] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:46 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:46.444924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:46.446580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:46.458677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:46.459528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:46.460592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:46.462771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:46.815619 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:46.841126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a27997f0-b764-430a-878e-7524c7a68d2d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1724 microversion: 2.1 time: 0.400198 Jun 15 00:43:46.843945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 262/487] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:46 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:47.388487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:47.390360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:47.399984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:47.400772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:47.401746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:47.402329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:47.642852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:47.652609 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:47.655019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:47.656476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1f30651d-775a-44bb-a22f-071576b29988 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.279023 Jun 15 00:43:47.657138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 226/488] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:47 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:47.861157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:47.861760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:47.868752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:47.869497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:47.870269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:47.870697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:48.055139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:48.066340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-eed112f4-cd26-4d07-b4ea-bd7b71b27b7b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.209248 Jun 15 00:43:48.066898 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 263/489] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:47 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:48.675052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:48.675849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:48.678481 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:48.683727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:48.685846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:48.685846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:48.685846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:48.837351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:48.850813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:48.854324 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:48.868108 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-43f00e9f-b0d1-4d0a-b578-0bf3dcf2c24d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.185356 Jun 15 00:43:48.868108 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 227/490] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:48 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:49.086037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:49.087845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:49.097318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:49.097924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:49.098912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:49.099515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:49.253328 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:49.264367 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f0a1c32b-f8c5-4e57-813d-95baf8147ba0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.183287 Jun 15 00:43:49.265322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 264/491] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:49 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:49.881617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:49.882974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:49.891659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:49.892242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:49.893203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:49.893727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:50.045950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:50.054916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:50.056647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:50.057783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-acbf738b-181a-48d6-8f5e-67bd765046e1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.181234 Jun 15 00:43:50.058329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 228/492] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:49 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:50.284244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:50.285757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:50.293060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:50.293497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:50.294246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:50.294669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:50.441967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:50.450889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-195c261b-9e02-4bf8-9b9c-2f3af9353d84 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.172420 Jun 15 00:43:50.453969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 265/493] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:50 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:51.077649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:51.078777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:51.085390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:51.085831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:51.088566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:51.088566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:51.224624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:51.233323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:51.234865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:51.236063 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d8ebb26f-c75f-4bf1-8350-99be7aa96a2b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.163569 Jun 15 00:43:51.236888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 229/494] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:51 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:51.469436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:51.470090 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:51.476830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:51.477352 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:51.478198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:51.478736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:51.617302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:51.624761 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-25e97c9e-108d-4456-983f-73522b2af80f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.159766 Jun 15 00:43:51.625353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 266/495] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:51 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:52.254631 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:52.255229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:52.261861 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:52.262305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:52.263053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:52.263482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:52.390693 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:52.399430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:52.400948 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:52.406176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-79324ba1-0332-4b36-bbd9-0bcd5208f86c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.151837 Jun 15 00:43:52.406176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 230/496] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:52 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:52.642520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:52.643113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:52.649496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:52.649933 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:52.650678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:52.651104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:52.777034 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:52.784456 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c19c0945-76e4-4e40-b6bd-81fbf469d4ee tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.146295 Jun 15 00:43:52.785003 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 267/497] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:52 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:53.420131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:53.420688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:53.427298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:53.427748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:53.431605 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:53.431605 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:53.558791 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:53.567519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:53.569050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:53.570194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d18e32c3-7ad6-4c1e-8be1-3ee444d34124 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.154015 Jun 15 00:43:53.570748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 231/498] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:53 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:53.801165 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:53.801759 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:53.808053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:53.808494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:53.809258 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:53.809680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:53.936394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:53.944516 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d79fd784-15c0-4e53-a934-fd906f70d955 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.147027 Jun 15 00:43:53.945022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 268/499] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:53 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:54.589084 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:54.589681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:54.596765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:54.597205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:54.598041 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:54.598471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:54.727517 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:54.736064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:54.737500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:54.738648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b3b4bc00-3584-49eb-bf47-8e2da8afa78f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.153409 Jun 15 00:43:54.739232 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 232/500] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:54 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:43:54.961469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:54.961982 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:54.968332 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:54.969406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:54.970149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:54.970575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:55.096791 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:55.104108 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6e366336-1af7-426a-a595-b6a76c7e51df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.146489 Jun 15 00:43:55.104663 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 269/501] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:54 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:55.757307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:55.758019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:55.765206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:55.765744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:55.766514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:55.766945 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:55.788186 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:55.901064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:55.910444 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:55.912114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:55.913534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0c8502de-5edb-4130-a275-a3c3f4763f33 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.160461 Jun 15 00:43:55.914216 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 233/502] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:55 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:56.121140 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:56.121735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:56.128083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:56.131773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:56.131773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:56.131773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:56.259314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:56.267442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f4dd6aec-b30b-4e77-93b5-b747396b1f7f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.150153 Jun 15 00:43:56.268018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 270/503] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:56 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:56.932920 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:56.933522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:56.941997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:56.942437 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:56.943212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:56.943638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:57.072234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:57.080621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:57.082221 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:57.083384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2bb8de73-a1b9-4184-bbb8-a5514f1438ea tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.154534 Jun 15 00:43:57.083963 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 234/504] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:56 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:57.285047 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:57.285651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:57.287986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=48 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:57.292699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:57.293245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:57.293988 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:57.294425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:57.422501 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:57.429846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-452b4287-e025-4698-af73-0d6c88aafb4b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1678 microversion: 2.1 time: 0.149144 Jun 15 00:43:57.430403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 271/505] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:57 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:58.102252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:58.102851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:58.110268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.110732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.111479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.111960 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.447861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:58.448732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:58.455850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.456324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.457122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.457552 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.458980 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:58.460236 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:58.467397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:58.469473 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:58.471513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4e656fca-3094-45e1-aaf7-26d15a1d15e4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.372386 Jun 15 00:43:58.471513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 235/506] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:58 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:58.583039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:58.591054 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-912fa838-c0c4-4de6-aad3-87c1ee0dfa26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1655 microversion: 2.1 time: 0.147032 Jun 15 00:43:58.591613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 272/507] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:58 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:43:58.607853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-84d8b1b3-eb8c-48a0-b334-7de5fd44cebf tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:43:58.614257 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-84d8b1b3-eb8c-48a0-b334-7de5fd44cebf tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.614788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-84d8b1b3-eb8c-48a0-b334-7de5fd44cebf tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.638383 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-84d8b1b3-eb8c-48a0-b334-7de5fd44cebf tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Going to try to start instance {{(pid=124682) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 00:43:58.809279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-84d8b1b3-eb8c-48a0-b334-7de5fd44cebf tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action" status: 202 len: 0 microversion: 2.1 time: 0.205148 Jun 15 00:43:58.809874 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 236/508] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:43:58 2022] POST /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:43:58.819338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:58.820282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:58.826278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.826723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.827558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:58.828016 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:58.970860 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:58.979261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-430db43e-2adc-4209-a35e-cf72c312aa67 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1664 microversion: 2.1 time: 0.164095 Jun 15 00:43:58.979829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 273/509] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:58 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:43:59.490775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:59.491473 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:43:59.498278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:59.498829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:59.499710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:43:59.500679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:43:59.627292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:59.635829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:59.637336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:43:59.638465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d8f7494c-cccc-4639-b68f-2840dff74179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.152519 Jun 15 00:43:59.639008 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 237/510] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:43:59 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:43:59.996480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:43:59.997047 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:00.003362 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:00.003798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:00.004576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:00.005003 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:00.133035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:00.141162 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0fcfa820-4dce-49c6-9a49-91ca2744a2b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1664 microversion: 2.1 time: 0.148126 Jun 15 00:44:00.141725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 274/511] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:43:59 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1664 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:00.657166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:00.658336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:00.665075 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:00.665519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:00.666334 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:00.666771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:00.737392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-3acf80ce-7ecc-4ca9-bc3f-732dc43899ab req-45676f88-32d3-4d7f-8a8e-9f6332ba4d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "name": "network-vif-plugged", "status": "completed", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:00.751025 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-3acf80ce-7ecc-4ca9-bc3f-732dc43899ab req-45676f88-32d3-4d7f-8a8e-9f6332ba4d11 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:00.751372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-3acf80ce-7ecc-4ca9-bc3f-732dc43899ab req-45676f88-32d3-4d7f-8a8e-9f6332ba4d11 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:00.765140 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-3acf80ce-7ecc-4ca9-bc3f-732dc43899ab req-45676f88-32d3-4d7f-8a8e-9f6332ba4d11 service nova] Creating event network-vif-plugged:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:44:00.770487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-3acf80ce-7ecc-4ca9-bc3f-732dc43899ab req-45676f88-32d3-4d7f-8a8e-9f6332ba4d11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037854 Jun 15 00:44:00.781556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 275/512] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:00.826259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:00.835625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:00.837894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:00.848244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-809223bb-486e-4a4d-8a45-fcc3b26c44d9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.185939 Jun 15 00:44:00.848244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 238/513] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:00 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:01.159736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:01.160407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:01.166623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:01.167069 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:01.167853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:01.172888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:01.299995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:01.307578 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7c9c35a3-585b-4db5-b356-9ee29f94b3bd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1668 microversion: 2.1 time: 0.152990 Jun 15 00:44:01.310505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 276/514] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:01 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:01.857788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:01.858422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:01.864880 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:01.865325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:01.866071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:01.866504 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:01.993952 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:02.002799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:02.004351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:02.005483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6bb1e8bd-acd4-4ce0-b604-30c741f5e1b9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.151558 Jun 15 00:44:02.006035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 239/515] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:01 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:03.023725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:03.024291 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:03.030795 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:03.031840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:03.032621 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:03.033058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:03.157280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:03.165600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:03.167126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:03.168316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5d7c49ac-a13b-400d-aeb0-82fa90907d4c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.148485 Jun 15 00:44:03.168874 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 277/516] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:03 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:04.186294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:04.186823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:04.193608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:04.194055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:04.194971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:04.195545 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:04.329950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:04.338266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:04.339834 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:04.340997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6fc4aec6-7771-495a-b0f6-d0a08585d33f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1810 microversion: 2.20 time: 0.158616 Jun 15 00:44:04.341539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 240/517] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:04 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:05.358763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:05.359861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:05.366298 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:05.366741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:05.367489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:05.367939 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:05.494032 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:05.502345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:05.503847 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:05.505061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0070171e-04af-4ef3-88f7-ae5cb3f4ec7b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1797 microversion: 2.20 time: 0.150139 Jun 15 00:44:05.505617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 278/518] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:05 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1797 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:05.880382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "594f220e-3866-4d4f-8921-1c36f88d2b91"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:05.881518 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:05.888317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:05.888767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:05.889523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:05.889957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:06.628793 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a6197625-de8f-4f40-9745-917ea043a9f4 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752374 Jun 15 00:44:06.629384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 241/519] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:44:05 2022] POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:14.103742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:14.104736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:14.111435 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:14.111879 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:14.112706 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:14.113154 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:14.135868 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lazy-loading 'flavor' on Instance uuid 8a3df95e-5c86-4e93-93e0-1e1063cd434e {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:44:14.382615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-047de571-24df-4cac-8a85-caac46d09252 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/action" status: 200 len: 32 microversion: 2.1 time: 0.283014 Jun 15 00:44:14.383271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 279/520] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:44:14 2022] POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:44:14.393715 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:14.394406 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:14.400613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:14.401059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:14.401817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:14.402247 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:14.533461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:14.541540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-909c24f8-c64e-40b8-b7ec-f661ac22f8c9 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.152636 Jun 15 00:44:14.542102 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 242/521] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:14 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:15.561512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:15.562206 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:15.568419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:15.568862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:15.569612 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:15.570041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:15.694605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:15.702507 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0e9c1dc7-f019-482f-b49d-e8dcfe3d342d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.145798 Jun 15 00:44:15.703061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 280/522] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:15 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:16.720534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:16.721134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:16.727527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:16.728004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:16.728757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:16.729188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:16.861827 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:16.870040 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f6fd0cec-6f9e-4927-af65-a63357f86b84 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.153864 Jun 15 00:44:16.870618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 243/523] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:16 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:17.887517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:17.888147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:17.894941 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:17.895380 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:17.896146 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:17.896570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:18.025489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:18.033905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-df189bde-abed-4908-9f54-51dd2b4355db tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.150460 Jun 15 00:44:18.034468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 281/524] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:17 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:19.051479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:19.052128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:19.054519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=34 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:19.059216 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:19.060462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:19.060462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:19.060894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:19.184741 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:19.192569 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-63374581-d9df-454c-b655-d4aac25e202c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.145580 Jun 15 00:44:19.193136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 244/525] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:19 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:20.209338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:20.209931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:20.216293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:20.216731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:20.217470 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:20.217896 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:20.346923 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:20.354821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-02b478ea-b5cc-4c5f-b01d-5daefb20c2e0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.149267 Jun 15 00:44:20.355381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 282/526] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:20 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:21.372529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:21.373129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:21.380256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:21.380708 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:21.381462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:21.381896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:21.513661 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:21.522236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-256e6951-2817-4737-a406-69b07f9fbd56 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.153576 Jun 15 00:44:21.522794 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 245/527] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:21 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:22.539171 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:22.545447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:22.546251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:22.546702 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:22.547457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:22.547885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:22.678555 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:22.686420 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-33bea538-699f-4373-977d-70d8b517a56d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.151175 Jun 15 00:44:22.692650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 283/528] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:22 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:23.704201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:23.704802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:23.711249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:23.711693 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:23.712638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:23.713076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:23.838652 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:23.847009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-403d287c-6acb-40cc-b760-7cd8bbf979ac tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.146695 Jun 15 00:44:23.847568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 246/529] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:23 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:24.864496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:24.865089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:24.871616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:24.872084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:24.872831 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:24.873255 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:25.002209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:25.010073 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fd901cd0-bcd9-43ad-ab88-77ad2ab6bbbf tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.149987 Jun 15 00:44:25.010630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 284/530] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:24 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:26.026820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:26.027360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:26.033789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:26.038620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:26.038620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:26.038620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:26.163996 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:26.167365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:26.172194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1540d90e-ed41-40bf-934c-c708f8f3547c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.149333 Jun 15 00:44:26.175598 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 247/531] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:26 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:27.190144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:27.190780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:27.197130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:27.197572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:27.198319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:27.198744 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:27.323485 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:27.331865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-db18aa93-5014-466d-b2a7-865ee03c019c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.146075 Jun 15 00:44:27.332438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 285/532] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:27 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:28.354297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:28.354297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:28.357397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:28.357852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:28.358624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:28.359082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:28.487077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:28.494951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d9915717-7a8d-46c7-8b47-9311183655f0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.149870 Jun 15 00:44:28.495512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 248/533] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:28 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:29.512707 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:29.513319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:29.515740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=30 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:29.520565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:29.523271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:29.523271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:29.523271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:29.526290 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:29.648001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:29.656168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e9801f88-838b-48b0-9981-3715deedecbb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.148191 Jun 15 00:44:29.656740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 286/534] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:29 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:30.674168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:30.674690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:30.681081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:30.681520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:30.682293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:30.682716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:30.806394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:30.814775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-20531d0a-e8f1-4601-ab7a-577f12d4961f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.144995 Jun 15 00:44:30.815326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 249/535] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:30 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:31.832437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:31.833044 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:31.839457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:31.839929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:31.840693 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:31.841128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:31.970293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:31.978042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9c85c290-19f0-433b-933a-7af77ccdac8b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.150163 Jun 15 00:44:31.978597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 287/536] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:31 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:32.995047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:32.995593 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:33.001911 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:33.002347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:33.003087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:33.003512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:33.127297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:33.135006 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-28fa9e19-fcda-4600-8a0d-755e992a3c6f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1736 microversion: 2.1 time: 0.143915 Jun 15 00:44:33.135555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 250/537] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:32 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1736 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:34.152720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:34.153354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:34.160279 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.160721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.161470 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.161897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.290730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:34.299391 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6e9ecd93-3e56-4049-a1f0-c21320a4179a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1716 microversion: 2.1 time: 0.150457 Jun 15 00:44:34.299966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 288/538] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:34 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:34.397974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:34.398465 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:34.404887 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.405273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.406025 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.406460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.526966 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] HTTP exception thrown: Cannot 'detach_volume' instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e while it is in vm_state rescued Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Request method failure captured: Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments/594f220e-3866-4d4f-8921-1c36f88d2b91 HTTP/1.1 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp6FerWeLuXsL_HulJ96wnm6NE0Rq3zf3omo9rkXGGvCB2ssQqm5WyRzI7WugYX27UaFxAyu8yzbGtNntz1VIR1LLTnRHD4CzIKgY9f0RHkOnrAVSzGw8l82C7w_8b44rmnXpdxqECdw5ZM6f7EfLqq6nrAy2txzEPhWP0qllabxcE Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:44:34.528608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdef82f627f42b29f6da17f6bad6dd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdef82f627f42b29f6da17f6bad6dd4"}]}] Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4989693e66c44d6a8e5f8543f1b9c516 Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:44:34.530192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Cannot 'detach_volume' instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e while it is in vm_state rescued Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'server_id': '8a3df95e-5c86-4e93-93e0-1e1063cd434e', 'id': '594f220e-3866-4d4f-8921-1c36f88d2b91'} Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:44:34.531012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e while it is in vm_state rescued Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e while it is in vm_state rescued Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:34.533077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Returning 409 to user: Cannot 'detach_volume' instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e while it is in vm_state rescued {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:44:34.534243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cd9fd930-c53f-492f-b6aa-a5d1c2611043 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments/594f220e-3866-4d4f-8921-1c36f88d2b91" status: 409 len: 152 microversion: 2.1 time: 0.136021 Jun 15 00:44:34.534243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 251/539] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:44:34 2022] DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments/594f220e-3866-4d4f-8921-1c36f88d2b91 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 00:44:34.539287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:34.539802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:34.545637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.546131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.546877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.547301 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.730336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6cbe3044-a73b-403e-a1ae-b1d0762c8017 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/action" status: 202 len: 0 microversion: 2.1 time: 0.194389 Jun 15 00:44:34.730945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 289/540] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:44:34 2022] POST /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:44:34.739376 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:34.743047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:34.748955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.755126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.755126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:34.755126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:34.879234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:34.887457 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b93d0cb5-ab85-4032-bc4c-4bc2d3d5e816 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1724 microversion: 2.1 time: 0.152198 Jun 15 00:44:34.888024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 252/541] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:34 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:35.906510 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:35.907209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:35.914013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:35.914460 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:35.915214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:35.915644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:36.043626 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:36.051594 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-51940c5e-f213-4f4e-b8d3-c33bb7c28137 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1724 microversion: 2.1 time: 0.149942 Jun 15 00:44:36.052187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 290/542] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:35 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:37.068906 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:37.069509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:37.076057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:37.076510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:37.077264 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:37.077698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:37.202839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:37.211404 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-eeaa8aa3-e850-4142-84b2-38655c73f79f tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1724 microversion: 2.1 time: 0.146392 Jun 15 00:44:37.211975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 253/543] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:37 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:38.228430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:38.229024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:38.235853 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.236323 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.237067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.237481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.361155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:38.368971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91d0bdc9-db76-438d-9896-3e4eee776d4a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1730 microversion: 2.1 time: 0.144354 Jun 15 00:44:38.369536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 291/544] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:38 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:38.385748 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:38.386508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:38.392891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.393330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.394077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.394530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.473041 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9d12e234-7d87-4d3b-b08c-c99500bac0eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091123 Jun 15 00:44:38.473623 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 254/545] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:44:38 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:38.864002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:38.864493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:38.870396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.871474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.871593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.872194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.900692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1c4a5e8-92d2-407a-8788-0b503c078ee6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments/06d42985-97ee-4464-be8e-6150c4c9f575" status: 200 len: 194 microversion: 2.20 time: 0.040648 Jun 15 00:44:38.901270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 292/546] 10.222.0.17 () {60 vars in 1453 bytes} [Wed Jun 15 00:44:38 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments/06d42985-97ee-4464-be8e-6150c4c9f575 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:44:38.962787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:38.979195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:38.979195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.979195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:38.979195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:38.979538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:39.051574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'services' on Instance uuid 4384856b-b368-4857-a5d7-431d19403918 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:44:39.320632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-01d749ad-d77f-4117-8af8-8922b4db1f59 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments/06d42985-97ee-4464-be8e-6150c4c9f575" status: 202 len: 0 microversion: 2.20 time: 0.361501 Jun 15 00:44:39.324668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 255/547] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jun 15 00:44:38 2022] DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments/06d42985-97ee-4464-be8e-6150c4c9f575 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:44:39.333011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:39.334099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:39.353840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:39.354285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:39.355255 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:39.355686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:39.361318 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d9d796d4-5de3-434a-9447-216cb3f9e27c req-ac8013ea-0327-4172-8cae-3cec559f1a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:39.369987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d9d796d4-5de3-434a-9447-216cb3f9e27c req-ac8013ea-0327-4172-8cae-3cec559f1a8e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:39.371066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d9d796d4-5de3-434a-9447-216cb3f9e27c req-ac8013ea-0327-4172-8cae-3cec559f1a8e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:39.383467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d9d796d4-5de3-434a-9447-216cb3f9e27c req-ac8013ea-0327-4172-8cae-3cec559f1a8e service nova] Creating event network-changed:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:44:39.390999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d9d796d4-5de3-434a-9447-216cb3f9e27c req-ac8013ea-0327-4172-8cae-3cec559f1a8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033918 Jun 15 00:44:39.392264 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 256/548] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:39.399435 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-42193b84-f487-4d23-816d-201be2d003d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073346 Jun 15 00:44:39.400309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 293/549] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jun 15 00:44:39 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:44:40.225003 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:40.226056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:40.232419 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.232962 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.233638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.234069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.264559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8454a8e2-ac93-4f36-a292-60ef700dbee5 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044963 Jun 15 00:44:40.265134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 257/550] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:44:40 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:44:40.324998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:40.325611 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:40.333014 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.333652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.334386 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.334890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.360093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:44:40.411456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:40.412321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:40.418287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.418727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.419475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.419918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.451754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2ca1a7c3-b493-4439-b367-32daa410d6d5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044960 Jun 15 00:44:40.452384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 258/551] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jun 15 00:44:40 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 00:44:40.630260 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81e5a53a-0ed3-42c6-aae8-cc27f232d8b3 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 204 len: 0 microversion: 2.1 time: 0.309676 Jun 15 00:44:40.630843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 294/552] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:44:40 2022] DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:44:40.639081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:40.639830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:40.646278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.646722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.647466 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:40.647893 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:40.775871 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:40.783273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1fb56589-acdc-4827-b605-e51ba0b21891 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1674 microversion: 2.1 time: 0.148256 Jun 15 00:44:40.783825 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 259/553] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:40 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:44:41.405590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6ce6d864-4fcf-46a0-b1cf-178808a267f7 req-666890ee-91e3-472f-a574-c4cfb484c654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:41.414625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6ce6d864-4fcf-46a0-b1cf-178808a267f7 req-666890ee-91e3-472f-a574-c4cfb484c654 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.414991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6ce6d864-4fcf-46a0-b1cf-178808a267f7 req-666890ee-91e3-472f-a574-c4cfb484c654 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.428245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6ce6d864-4fcf-46a0-b1cf-178808a267f7 req-666890ee-91e3-472f-a574-c4cfb484c654 service nova] Creating event network-changed:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:44:41.433138 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6ce6d864-4fcf-46a0-b1cf-178808a267f7 req-666890ee-91e3-472f-a574-c4cfb484c654 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031512 Jun 15 00:44:41.433710 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 295/554] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:41.463850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:41.464780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:41.471629 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.472101 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.472858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.473288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.501759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c59b2055-fb16-469b-a422-ada4402ab136 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041807 Jun 15 00:44:41.502296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 260/555] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jun 15 00:44:41 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:41.559245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:41.559850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:41.566093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.566540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.567293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.567724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.592223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:44:41.801570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:41.802199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:41.808248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.808657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.809445 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.809879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.914470 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2fbff23c-3975-4ae6-a547-e3700058aed6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 204 len: 0 microversion: 2.20 time: 0.359212 Jun 15 00:44:41.915058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 296/556] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jun 15 00:44:41 2022] DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 00:44:41.923480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:41.928840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:41.930581 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.931026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.931841 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:41.932244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:41.939013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:41.946488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-055334ec-eb3d-48d3-8adb-f248a4f7fab1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1674 microversion: 2.1 time: 0.149436 Jun 15 00:44:41.947076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 261/557] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:41 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:44:42.058246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:42.066143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:42.067706 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:42.068882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-477189c2-6339-4a83-9c2e-f32a31ac0e95 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.149448 Jun 15 00:44:42.069441 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 297/558] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:41 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:44:42.964591 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:42.965166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:42.972036 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:42.978969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:42.978969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:42.978969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:43.087042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:43.087756 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:43.094400 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:43.095349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:43.096171 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:43.096604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:43.099758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:43.107214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fad9a148-555e-444b-a87c-3a3992dc4f26 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1674 microversion: 2.1 time: 0.146567 Jun 15 00:44:43.107772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 262/559] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:42 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:43.224703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:43.232486 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:43.233978 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:43.235113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2f607a6f-22b7-41fc-b224-be650052f97a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.152057 Jun 15 00:44:43.236336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 298/560] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:43 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:44:44.125296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:44.126436 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:44.132844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:44.133284 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:44.134024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:44.134449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:44.254469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:44.255073 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:44.261291 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:44.262084 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:44.262594 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:44.263429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:44.263928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:44.268135 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:44.268951 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-073c2846-3af7-4a4a-ba41-6d651483be79 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1674 microversion: 2.1 time: 0.147421 Jun 15 00:44:44.269514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 263/561] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:44 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:44.391244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:44.400987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:44.402472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:44.403652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d47513fd-61f1-4472-bf41-4055d30f542d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1725 microversion: 2.20 time: 0.153685 Jun 15 00:44:44.404513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 299/562] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:44 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:44:45.287739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:45.289076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:45.296519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.296972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.298340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.298987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.424131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:45.424669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:45.433654 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.434146 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.434921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.435354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.534287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:45.538016 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:45.547299 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-49f77620-a40f-40c9-a10c-da70412cd375 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1607 microversion: 2.1 time: 0.264142 Jun 15 00:44:45.551621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 264/563] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:45 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1607 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:45.557042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:45.568540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:45.570059 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:45.571317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b0f45ee7-1dd8-4e3d-af97-6b9f5636e50e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1658 microversion: 2.20 time: 0.152583 Jun 15 00:44:45.576886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 300/564] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:45 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:45.692545 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-5b06584d-86c4-471f-af06-2a8ce6f1b480 req-a6aac199-b771-4bca-aa29-4823b58b3de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4384856b-b368-4857-a5d7-431d19403918", "name": "network-vif-deleted", "tag": "516c886f-1287-4137-846d-8dcdc196b917"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:45.702160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5b06584d-86c4-471f-af06-2a8ce6f1b480 req-a6aac199-b771-4bca-aa29-4823b58b3de5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.702907 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5b06584d-86c4-471f-af06-2a8ce6f1b480 req-a6aac199-b771-4bca-aa29-4823b58b3de5 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.716554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-5b06584d-86c4-471f-af06-2a8ce6f1b480 req-a6aac199-b771-4bca-aa29-4823b58b3de5 service nova] Creating event network-vif-deleted:516c886f-1287-4137-846d-8dcdc196b917 for instance 4384856b-b368-4857-a5d7-431d19403918 on hv-cinder-84517 Jun 15 00:44:45.723151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-5b06584d-86c4-471f-af06-2a8ce6f1b480 req-a6aac199-b771-4bca-aa29-4823b58b3de5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Jun 15 00:44:45.726647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 265/565] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:45.806115 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-a2c39b9a-3117-48dc-a1ce-84b21ff83ae6 req-4aa4f08a-66ef-4000-834e-cd9abc0b6f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902f043a-d22e-41d1-b8f7-166e9d9080ba", "name": "network-vif-deleted", "tag": "328cf711-88b8-4cb7-8fdb-8f6cf8d10c56"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:45.814698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-a2c39b9a-3117-48dc-a1ce-84b21ff83ae6 req-4aa4f08a-66ef-4000-834e-cd9abc0b6f88 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:45.815247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-a2c39b9a-3117-48dc-a1ce-84b21ff83ae6 req-4aa4f08a-66ef-4000-834e-cd9abc0b6f88 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:45.829429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-a2c39b9a-3117-48dc-a1ce-84b21ff83ae6 req-4aa4f08a-66ef-4000-834e-cd9abc0b6f88 service nova] Creating event network-vif-deleted:328cf711-88b8-4cb7-8fdb-8f6cf8d10c56 for instance 902f043a-d22e-41d1-b8f7-166e9d9080ba on hv-cinder-84517 Jun 15 00:44:45.837304 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-a2c39b9a-3117-48dc-a1ce-84b21ff83ae6 req-4aa4f08a-66ef-4000-834e-cd9abc0b6f88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034898 Jun 15 00:44:45.840921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 301/566] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:46.567600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:46.569990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:46.577420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.577872 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.578649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.579089 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.598019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:46.599563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:46.605334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.605777 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.606720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.607145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.620093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.620674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.621199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lazy-loading 'fault' on Instance uuid 902f043a-d22e-41d1-b8f7-166e9d9080ba {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:44:46.680616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:46.681068 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:46.681523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'fault' on Instance uuid 4384856b-b368-4857-a5d7-431d19403918 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:44:46.688859 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:46.698550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bbfb810c-d5a9-4e03-9830-644b73111fbb tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 200 len: 1327 microversion: 2.1 time: 0.136339 Jun 15 00:44:46.699888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 266/567] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:46 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:46.733466 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:46.743131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:46.744832 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:46.746210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f4008015-6265-4c61-8e42-7ee3118b4f08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 200 len: 1372 microversion: 2.20 time: 0.158968 Jun 15 00:44:46.749327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 302/568] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:46 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:44:47.715871 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:47.716541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:47.723054 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:47.723492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:47.724255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:47.724680 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:47.738706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba HTTP/1.1 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:44:47.740263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:44:47.741753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '902f043a-d22e-41d1-b8f7-166e9d9080ba'} Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:44:47.742663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:44:47.744458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.746487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:44:47.746487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a8d7a060-5e6f-4ab0-b303-a050da8408b4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 404 len: 111 microversion: 2.1 time: 0.029622 Jun 15 00:44:47.746487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 267/569] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:47 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:44:47.752856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8948c47d-9650-4c45-bab6-d11cb26293c9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '.version_select at 0x7fa81f771e50>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:47.765204 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:47.766019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:47.772756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:47.773201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:47.773957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:47.774388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:47.787659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 HTTP/1.1 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:44:47.789199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:44:47.790811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '4384856b-b368-4857-a5d7-431d19403918'} Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:44:47.791618 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:44:47.792967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:44:47.794256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:44:47.794256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5a6918a5-cbbe-4af5-8d37-9fe4c9229986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 404 len: 111 microversion: 2.20 time: 0.029535 Jun 15 00:44:47.794256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 268/570] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:47 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 00:44:47.799625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94ffa38e-cd7f-45fb-9e79-f4bd0548bfc7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '.version_select at 0x7fa81f76a3a0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:47.835585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8948c47d-9650-4c45-bab6-d11cb26293c9 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418457759" status: 202 len: 0 microversion: 2.1 time: 0.086862 Jun 15 00:44:47.836222 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 303/571] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jun 15 00:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418457759 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:44:47.883008 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94ffa38e-cd7f-45fb-9e79-f4bd0548bfc7 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107906281" status: 204 len: 0 microversion: 2.20 time: 0.087286 Jun 15 00:44:47.883659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 269/572] 10.222.0.17 () {60 vars in 1261 bytes} [Wed Jun 15 00:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107906281 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 00:44:48.698440 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1f394d03-cfd7-412e-a9fd-3eb0d7c39096 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: .version_select at 0x7fa824103310>, body: {"keypair": {"name": "tempest-keypair-17043167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuGefj6Yq4IMaabRxO8qIsR3L/zsAY9oJqeol0RtHxEt9aXPA40Fi8u0WwEgl6y3GWNKExkyh3ndohth2NOICDc7+K9ihKp0gsMHA5tgvmNVZMslE6ZHy1C5y7pfQSKAg=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:48.713169 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1f394d03-cfd7-412e-a9fd-3eb0d7c39096 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for project 30f2ff4320764a69bb987d567aed9201. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:44:48.717379 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1f394d03-cfd7-412e-a9fd-3eb0d7c39096 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for user d9a0bbb1f50c42acb50dac254a653da4 and project 30f2ff4320764a69bb987d567aed9201. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:44:48.733310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fb1e38f8-accd-4a58-adcb-cb80f2b6f11a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: .version_select at 0x7fa81f7e7430>, body: {"keypair": {"name": "tempest-keypair-944906613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtxopB0x4bM2+G6sHCRt3mFdMoLF3YmxdtaoAlfWSldAwFa2iabd85cdL2rDETtLX2BXgfN7gY33fgmgwJce0ehyWRbe2X9T5r0gRF3ugeRboc337DsUIi80fLzQennVQ=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:48.748471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-fb1e38f8-accd-4a58-adcb-cb80f2b6f11a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:44:48.752765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-fb1e38f8-accd-4a58-adcb-cb80f2b6f11a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for user 2ff9f53decbc44ce9166f6c841e8ea02 and project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:44:48.802234 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1f394d03-cfd7-412e-a9fd-3eb0d7c39096 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.107899 Jun 15 00:44:48.802863 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 304/573] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:44:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:48.825040 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fb1e38f8-accd-4a58-adcb-cb80f2b6f11a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.096149 Jun 15 00:44:48.825648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 270/574] 10.222.0.17 () {62 vars in 1199 bytes} [Wed Jun 15 00:44:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 15 00:44:51.478039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1947425773", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f05909d-25bd-4873-b7be-db4fac7f0a83"}], "security_groups": [{"name": "tempest-securitygroup--966796920"}], "key_name": "tempest-keypair-17043167", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:51.586748 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] validate_networks() for [('2f05909d-25bd-4873-b7be-db4fac7f0a83', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:44:51.691161 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-219246562", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3ec445d-ab47-4471-b545-ed383178588a"}], "security_groups": [{"name": "tempest-securitygroup--1102330396"}], "key_name": "tempest-keypair-944906613", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:51.699177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:51.828203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] validate_networks() for [('d3ec445d-ab47-4471-b545-ed383178588a', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:44:52.106421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:44:52.106912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:44:52.107488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:44:52.107990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:44:52.108468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:44:52.119475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:52.120059 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:52.121139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:52.121687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:52.142980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for project 30f2ff4320764a69bb987d567aed9201. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:44:52.147852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Getting quotas for user d9a0bbb1f50c42acb50dac254a653da4 and project 30f2ff4320764a69bb987d567aed9201. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:44:52.160794 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:44:52.163398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:44:52.310248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:44:52.316251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:44:52.316251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:44:52.316251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:44:52.316251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:44:52.320949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:52.321393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:52.322183 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:52.322614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:52.340105 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:44:52.344252 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Getting quotas for user 2ff9f53decbc44ce9166f6c841e8ea02 and project 5075d84d5c6f4ad89f397c8b563e17df. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:44:52.355982 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:44:52.362214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:44:52.392372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bad13975-fd40-41a7-a3f7-bde4ca6207ea tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.918724 Jun 15 00:44:52.393276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 305/575] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:44:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:44:52.403054 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1fa154e-97d2-43d8-bc3b-156f7b426f0a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:52.403749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1fa154e-97d2-43d8-bc3b-156f7b426f0a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:52.462421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1fa154e-97d2-43d8-bc3b-156f7b426f0a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:52.467348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6efdc7a7-2266-43a7-b8f7-124d15a2b63e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.781705 Jun 15 00:44:52.470768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 271/576] 10.222.0.17 () {62 vars in 1187 bytes} [Wed Jun 15 00:44:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 00:44:52.477462 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1fa154e-97d2-43d8-bc3b-156f7b426f0a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1236 microversion: 2.1 time: 0.078231 Jun 15 00:44:52.478196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 306/577] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:52 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:44:52.491638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:52.492479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:52.549258 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:52.557616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:52.559569 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:52.561725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-99aff80d-58d9-42b0-b0de-76714105397c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1280 microversion: 2.20 time: 0.084225 Jun 15 00:44:52.562800 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 272/578] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:52 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:53.494449 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:53.495035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:53.501603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:53.502048 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:53.502800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:53.503235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:53.565405 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:53.572900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-db7fcdd3-b6b3-4ce4-9ec0-efda14a98798 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1240 microversion: 2.1 time: 0.082475 Jun 15 00:44:53.577238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 307/579] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:53 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:53.579630 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:53.580282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:53.586986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:53.587432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:53.588206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:53.588640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:53.650415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:53.658989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:53.660625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:53.661865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b0eaa92a-ab5e-4d50-97a7-ddc56b758a20 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1284 microversion: 2.20 time: 0.085952 Jun 15 00:44:53.662413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 273/580] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:53 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:54.590130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:54.590750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:54.596901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:54.597343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:54.598095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:54.598523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:54.666951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:54.675408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-62282e98-d437-438d-8cea-1f2cbc60419f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1288 microversion: 2.1 time: 0.088952 Jun 15 00:44:54.676009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 308/581] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:54 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:54.689969 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:54.695795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:54.697684 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:54.698138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:54.698897 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:54.699325 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:54.768917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:54.777170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:54.778642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:54.782129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-efdd4a7f-e271-475a-999f-f522f23a721b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1340 microversion: 2.20 time: 0.103833 Jun 15 00:44:54.782129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 274/582] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:54 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:55.693751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:55.695107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:55.703083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:55.703615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:55.705091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:55.705746 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:55.798922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:55.799865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:55.807025 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:55.807522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:55.808576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:55.809016 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:55.809132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:55.817476 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e66af2aa-7902-4300-a7eb-601c4c39e2ef tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1294 microversion: 2.1 time: 0.127811 Jun 15 00:44:55.818381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 309/583] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:55 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:55.886383 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:55.895451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:55.896978 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:55.898085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-44935435-c71f-4f11-bae9-0540f8952179 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1338 microversion: 2.20 time: 0.103532 Jun 15 00:44:55.898895 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 275/584] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:55 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:56.846296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:56.847592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:56.861602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:56.862132 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:56.863898 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:56.864802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:56.919956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-0649177e-c95d-4c3c-bbda-8c277cdfcfba req-1681e361-7319-44f2-a5d6-9869a8cd09fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5359c5e5-5c3a-4c52-8e2f-142553746c5c", "tag": "44ea47e2-3ec1-4b18-b3e1-c91beaccff1a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:56.933454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0649177e-c95d-4c3c-bbda-8c277cdfcfba req-1681e361-7319-44f2-a5d6-9869a8cd09fa service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:56.934942 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-0649177e-c95d-4c3c-bbda-8c277cdfcfba req-1681e361-7319-44f2-a5d6-9869a8cd09fa service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:56.947745 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-0649177e-c95d-4c3c-bbda-8c277cdfcfba req-1681e361-7319-44f2-a5d6-9869a8cd09fa service nova] Creating event network-changed:44ea47e2-3ec1-4b18-b3e1-c91beaccff1a for instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c on hv-cinder-84517 Jun 15 00:44:56.954760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-0649177e-c95d-4c3c-bbda-8c277cdfcfba req-1681e361-7319-44f2-a5d6-9869a8cd09fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039875 Jun 15 00:44:56.956140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 276/585] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:44:56.963121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:56.965017 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:56.973842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:56.977072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:56.977072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:56.977072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:57.177421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:57.183995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8f2a07a8-3dc1-4435-b985-ccd1c21d7f47 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.344548 Jun 15 00:44:57.185398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 310/586] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:56 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:57.197124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-f7ea73e3-262d-4f65-827f-bc0664cd9a53 req-9f2b007b-9bd6-439e-9ea3-ddf22bd65052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:44:57.207511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-f7ea73e3-262d-4f65-827f-bc0664cd9a53 req-9f2b007b-9bd6-439e-9ea3-ddf22bd65052 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:57.207977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-f7ea73e3-262d-4f65-827f-bc0664cd9a53 req-9f2b007b-9bd6-439e-9ea3-ddf22bd65052 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:57.220046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-f7ea73e3-262d-4f65-827f-bc0664cd9a53 req-9f2b007b-9bd6-439e-9ea3-ddf22bd65052 service nova] Creating event network-changed:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:44:57.225415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-f7ea73e3-262d-4f65-827f-bc0664cd9a53 req-9f2b007b-9bd6-439e-9ea3-ddf22bd65052 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038347 Jun 15 00:44:57.226402 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 311/587] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:44:57.244769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:57.256019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:57.257995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:57.259403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a496cc61-ff01-4541-b9c7-a5de830d961d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.301901 Jun 15 00:44:57.260597 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 277/588] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:56 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:44:58.202693 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:58.203373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:58.209550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:58.209987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:58.210729 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:58.211176 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:58.278384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:58.278988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:58.285937 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:58.286398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:58.287225 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:58.287656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:58.364335 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:58.371627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ea62aec-69d2-4d05-82f6-dc2c559033d1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.173534 Jun 15 00:44:58.372375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 312/589] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:58 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:58.427610 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:58.435932 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:58.437425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:58.439196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1e620e85-ec1b-47de-99c4-25ba33de16a3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.164635 Jun 15 00:44:58.439756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 278/590] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:58 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:44:59.388944 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:59.389548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:59.396120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:59.396564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:59.397312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:59.397741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:59.456916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:44:59.457543 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:44:59.464048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:59.467059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:59.467059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:44:59.467059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:44:59.558492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:59.563408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bcae992d-a0ac-49bb-bc05-4b8c162b8bfc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.178550 Jun 15 00:44:59.563998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 313/591] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:44:59 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:44:59.616496 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:59.624493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:59.625994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:44:59.627096 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ef6b21bc-6cd9-42ff-8081-d373b08d6547 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.174048 Jun 15 00:44:59.627646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 279/592] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:44:59 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:00.580704 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:00.581303 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:00.583720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:00.588438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:00.588878 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:00.589643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:00.590060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:00.645891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:00.646519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:00.653048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:00.653500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:00.654348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:00.654779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:00.760223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:00.768730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c4ff1fe6-7eb8-4165-a1f1-53d91019721c tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.192412 Jun 15 00:45:00.769300 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 314/593] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:00 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:00.804522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:00.812314 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:00.813845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:00.814927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-33c160d5-cd01-4e39-be2a-63ece8d21df3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.173513 Jun 15 00:45:00.815479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 280/594] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:00 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:01.785850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:01.786518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:01.792610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:01.793049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:01.793794 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:01.794218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:01.832721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:01.833354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:01.840225 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:01.840667 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:01.841425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:01.841849 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:01.971773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:01.979103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b9927db8-2e5f-4f73-80c1-8875f27a899e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.197587 Jun 15 00:45:01.979644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 315/595] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:01 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:02.000960 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:02.008744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:02.010234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:02.011329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e792d023-e9ce-45b5-ac62-d54ed833cd2c tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.182482 Jun 15 00:45:02.012142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 281/596] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:01 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:02.996671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:02.997276 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:02.999284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:03.000019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=12 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:03.005887 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:03.006331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:03.007093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:03.007522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:03.029365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:03.030034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:03.033630 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:03.034537 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=12 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:03.038844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:03.039388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:03.040264 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:03.040974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:03.222269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:03.223752 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:03.230580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-890ea2f1-fe7f-4858-8d0e-d3669512c72b tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.237783 Jun 15 00:45:03.235674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 316/597] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:02 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:03.235853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:03.235853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:03.235853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e6512cbc-a34b-4415-8c01-82520ff3fa08 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.209577 Jun 15 00:45:03.236780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 282/598] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:03 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:03.303889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6fc71f18-92e5-4846-8f80-d4a7779f01d9 req-e967a290-2fb4-4b7b-afbe-b54a6d4f82f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:03.312658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6fc71f18-92e5-4846-8f80-d4a7779f01d9 req-e967a290-2fb4-4b7b-afbe-b54a6d4f82f9 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:03.321687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6fc71f18-92e5-4846-8f80-d4a7779f01d9 req-e967a290-2fb4-4b7b-afbe-b54a6d4f82f9 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:03.326602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6fc71f18-92e5-4846-8f80-d4a7779f01d9 req-e967a290-2fb4-4b7b-afbe-b54a6d4f82f9 service nova] Creating event network-vif-plugged:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:45:03.331637 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6fc71f18-92e5-4846-8f80-d4a7779f01d9 req-e967a290-2fb4-4b7b-afbe-b54a6d4f82f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031511 Jun 15 00:45:03.332525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 317/599] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:04.248710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:04.249313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:04.253220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:04.253903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:04.255722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:04.256194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:04.256955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:04.257384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:04.260592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:04.261035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:04.262023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:04.262454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:04.447403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:04.454707 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:04.455331 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a188d3be-41c4-475a-b2e4-e771655be962 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.211486 Jun 15 00:45:04.455957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 283/600] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:04 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:04.462988 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:04.464504 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:04.465625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5856299d-bef4-416d-bcc5-d02fd870c6c0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.216736 Jun 15 00:45:04.466203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 318/601] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:04 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:05.346128 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d96f8371-3def-4617-aab0-19cf97c0e553 req-9f34a03c-fd0a-4ada-b7a1-b9b3bbea49ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c5e5-5c3a-4c52-8e2f-142553746c5c", "name": "network-vif-plugged", "status": "completed", "tag": "44ea47e2-3ec1-4b18-b3e1-c91beaccff1a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:05.354382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d96f8371-3def-4617-aab0-19cf97c0e553 req-9f34a03c-fd0a-4ada-b7a1-b9b3bbea49ed service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:05.354820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d96f8371-3def-4617-aab0-19cf97c0e553 req-9f34a03c-fd0a-4ada-b7a1-b9b3bbea49ed service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:05.366139 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d96f8371-3def-4617-aab0-19cf97c0e553 req-9f34a03c-fd0a-4ada-b7a1-b9b3bbea49ed service nova] Creating event network-vif-plugged:44ea47e2-3ec1-4b18-b3e1-c91beaccff1a for instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c on hv-cinder-84517 Jun 15 00:45:05.374410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d96f8371-3def-4617-aab0-19cf97c0e553 req-9f34a03c-fd0a-4ada-b7a1-b9b3bbea49ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028505 Jun 15 00:45:05.374410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 284/602] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:05.474594 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:05.475272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:05.483277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:05.483824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:05.488990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:05.489119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:05.489119 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:05.489266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:05.493055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:05.493508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:05.494269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:05.494704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:05.688022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:05.693662 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:05.695812 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-29962989-64ef-40a1-aaf0-0982a3fd884f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.225201 Jun 15 00:45:05.696622 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 319/603] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:05 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:05.714876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:05.716479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:05.717574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c527fbe0-ef01-42df-bfe4-aaa99967ba8a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1406 microversion: 2.20 time: 0.237313 Jun 15 00:45:05.718124 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 285/604] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:05 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:06.712687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:06.713282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:06.719646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.720129 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.720891 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.721314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.736494 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:06.737674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:06.743916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.744371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.745156 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.745586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.916691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:06.920521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:06.925849 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4c05d4a6-ece4-47ba-b901-2e05e56ee7a8 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1361 microversion: 2.1 time: 0.215997 Jun 15 00:45:06.925849 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 320/605] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:06 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:06.929510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:06.931009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:06.932166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c7e5ce8a-8f56-4fba-bdb7-c52a1c18bd8e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1599 microversion: 2.20 time: 0.200141 Jun 15 00:45:06.932706 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 286/606] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:06 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:06.949327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:06.949809 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:06.956000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.956447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.957200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:06.957632 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:06.961358 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:07.032902 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e3686cfd-c711-4c82-acc1-40b699203f62 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087365 Jun 15 00:45:07.033490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 321/607] 10.222.0.17 () {60 vars in 1315 bytes} [Wed Jun 15 00:45:06 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 00:45:07.942048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:07.942780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:07.949232 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:07.949679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:07.950434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:07.950865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:08.031929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-6803479f-46f2-40e6-b1c9-812c53d6e43b req-c8390dc6-7460-445a-9337-e256479e8831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:08.039842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6803479f-46f2-40e6-b1c9-812c53d6e43b req-c8390dc6-7460-445a-9337-e256479e8831 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:08.040313 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-6803479f-46f2-40e6-b1c9-812c53d6e43b req-c8390dc6-7460-445a-9337-e256479e8831 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:08.055129 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-6803479f-46f2-40e6-b1c9-812c53d6e43b req-c8390dc6-7460-445a-9337-e256479e8831 service nova] Creating event network-changed:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:45:08.060249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-6803479f-46f2-40e6-b1c9-812c53d6e43b req-c8390dc6-7460-445a-9337-e256479e8831 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032552 Jun 15 00:45:08.061265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 322/608] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:45:08.100329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:08.107955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1b63c82d-edae-4323-b2f0-183e90100ee7 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1547 microversion: 2.1 time: 0.170169 Jun 15 00:45:08.108789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 287/609] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:07 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:08.131824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:08.131824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:08.135403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:08.135972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:08.136833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:08.137647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:08.266164 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3b820a90-c57f-4286-8261-7fff08890f15 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144082 Jun 15 00:45:08.266826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 323/610] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:45:08 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:09.269499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-b3cb67f1-daa5-4434-b08d-be7c00e2c71f req-efd543c0-fd7d-4079-8a76-7c9d1cdfeda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5359c5e5-5c3a-4c52-8e2f-142553746c5c", "tag": "44ea47e2-3ec1-4b18-b3e1-c91beaccff1a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:09.277991 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b3cb67f1-daa5-4434-b08d-be7c00e2c71f req-efd543c0-fd7d-4079-8a76-7c9d1cdfeda2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:09.278435 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b3cb67f1-daa5-4434-b08d-be7c00e2c71f req-efd543c0-fd7d-4079-8a76-7c9d1cdfeda2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:09.282215 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=100 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:09.289114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-b3cb67f1-daa5-4434-b08d-be7c00e2c71f req-efd543c0-fd7d-4079-8a76-7c9d1cdfeda2 service nova] Creating event network-changed:44ea47e2-3ec1-4b18-b3e1-c91beaccff1a for instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c on hv-cinder-84517 Jun 15 00:45:09.300585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-b3cb67f1-daa5-4434-b08d-be7c00e2c71f req-efd543c0-fd7d-4079-8a76-7c9d1cdfeda2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028681 Jun 15 00:45:09.300585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 288/611] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:17.264833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:17.265313 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:17.271821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:17.272297 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:17.273054 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:17.273552 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:17.525347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lazy-loading 'services' on Instance uuid 8a3df95e-5c86-4e93-93e0-1e1063cd434e {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:45:17.720219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5f34ff70-781c-4241-9f87-084d72a5625b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments/594f220e-3866-4d4f-8921-1c36f88d2b91" status: 202 len: 0 microversion: 2.1 time: 0.460124 Jun 15 00:45:17.720860 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 324/612] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:45:17 2022] DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments/594f220e-3866-4d4f-8921-1c36f88d2b91 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:45:17.731043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:17.732063 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:17.738616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:17.739059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:17.740241 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:17.740403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:17.770453 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-59febab2-c55a-4b88-a572-592130ac1214 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Jun 15 00:45:17.770908 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 289/613] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:45:17 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:18.783197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:18.784274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:18.791309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:18.791762 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:18.792649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:18.793079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:18.823763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-84055676-d23c-466f-81bd-ee618feb6347 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Jun 15 00:45:18.827052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 325/614] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:45:18 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:19.835272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:19.836226 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:19.842649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:19.846373 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:19.846373 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:19.846373 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:19.872757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-80b5ede8-a405-4fec-a151-97db3ab5b7be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041429 Jun 15 00:45:19.875035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 290/615] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:45:19 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:45:19.947063 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:19.947588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:19.953939 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:19.960886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:19.960886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:19.960886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:19.979624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:45:20.217843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-de5ee882-a2cf-41b1-b7f9-74e5006c79be tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 204 len: 0 microversion: 2.1 time: 0.274282 Jun 15 00:45:20.218402 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 326/616] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:45:19 2022] DELETE /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:45:20.226772 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:20.227429 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:20.233422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:20.233868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:20.234619 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:20.235052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:20.457868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:20.465454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b84f6ed5-1eb6-419c-856a-b484201bcebe tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1690 microversion: 2.1 time: 0.242453 Jun 15 00:45:20.466008 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 291/617] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:20 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:21.482997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:21.483682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:21.490641 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:21.491075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:21.491813 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:21.492269 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:21.621524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:21.628901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-749c68af-0c09-439c-867f-f5f8724d6d83 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1690 microversion: 2.1 time: 0.150198 Jun 15 00:45:21.629454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 327/618] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:21 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:22.645891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:22.646487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:22.648958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:22.653726 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:22.654210 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:22.654953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:22.655382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:22.786429 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:22.793758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d33f2957-5490-411a-ad53-ea3ef6962a4d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1690 microversion: 2.1 time: 0.151645 Jun 15 00:45:22.794313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 292/619] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:22 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:23.810580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:23.811187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:23.818225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:23.818671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:23.819416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:23.819846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:23.977389 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:23.985422 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5655db22-4c0e-4d57-85ba-92445415cd44 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1690 microversion: 2.1 time: 0.178209 Jun 15 00:45:23.985975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 328/620] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:23 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:24.922099 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-17fa248b-aac8-4e26-88b4-fc9d1845f10e req-e3dc6e8b-fbf4-47b1-bd9c-7c1a7174aa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3df95e-5c86-4e93-93e0-1e1063cd434e", "name": "network-vif-deleted", "tag": "e7b25b1b-96a5-44b4-8e31-79c49e2194d9"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:24.931059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-17fa248b-aac8-4e26-88b4-fc9d1845f10e req-e3dc6e8b-fbf4-47b1-bd9c-7c1a7174aa10 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:24.931059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-17fa248b-aac8-4e26-88b4-fc9d1845f10e req-e3dc6e8b-fbf4-47b1-bd9c-7c1a7174aa10 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:24.942153 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-17fa248b-aac8-4e26-88b4-fc9d1845f10e req-e3dc6e8b-fbf4-47b1-bd9c-7c1a7174aa10 service nova] Creating event network-vif-deleted:e7b25b1b-96a5-44b4-8e31-79c49e2194d9 for instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e on hv-cinder-84517 Jun 15 00:45:24.947112 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-17fa248b-aac8-4e26-88b4-fc9d1845f10e req-e3dc6e8b-fbf4-47b1-bd9c-7c1a7174aa10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028628 Jun 15 00:45:24.947949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 293/621] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:25.002883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:25.004124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:25.011049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:25.011752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:25.013631 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:25.014184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:25.090732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:25.100764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-02b39268-8a38-4ecd-b4aa-91d08a516093 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 200 len: 1623 microversion: 2.1 time: 0.102158 Jun 15 00:45:25.102468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 329/622] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:24 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 1623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:26.119563 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:26.120197 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 8a3df95e-5c86-4e93-93e0-1e1063cd434e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:26.126371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:26.126836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:26.127591 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:26.128058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:26.141750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] HTTP exception thrown: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Request method failure captured: Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e HTTP/1.1 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp6FerWeLuXsL_HulJ96wnm6NE0Rq3zf3omo9rkXGGvCB2ssQqm5WyRzI7WugYX27UaFxAyu8yzbGtNntz1VIR1LLTnRHD4CzIKgY9f0RHkOnrAVSzGw8l82C7w_8b44rmnXpdxqECdw5ZM6f7EfLqq6nrAy2txzEPhWP0qllabxcE Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:45:26.143345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdef82f627f42b29f6da17f6bad6dd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdef82f627f42b29f6da17f6bad6dd4"}]}] Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4989693e66c44d6a8e5f8543f1b9c516 Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. Jun 15 00:45:26.146701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '8a3df95e-5c86-4e93-93e0-1e1063cd434e'} Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:45:26.147570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. Jun 15 00:45:26.149145 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:26.150452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Returning 404 to user: Instance 8a3df95e-5c86-4e93-93e0-1e1063cd434e could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:45:26.150452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bc369f2b-4b27-4bb9-ab2e-c128355b9d13 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e" status: 404 len: 111 microversion: 2.1 time: 0.029975 Jun 15 00:45:26.150452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 294/623] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:26 2022] GET /compute/v2.1/servers/8a3df95e-5c86-4e93-93e0-1e1063cd434e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:45:26.153281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bdce0c4c-c2c3-4a6d-83b5-9a210e7176eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '.version_select at 0x7fa81f735700>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:26.224756 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bdce0c4c-c2c3-4a6d-83b5-9a210e7176eb tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105813574" status: 202 len: 0 microversion: 2.1 time: 0.075156 Jun 15 00:45:26.225309 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 330/624] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jun 15 00:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105813574 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:45:27.118845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:27.119386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:27.126342 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:27.129796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:27.129796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:27.129796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:27.149750 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lazy-loading 'flavor' on Instance uuid c697d7d3-580e-4230-9460-8e6718bab104 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:45:27.405521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-543d243f-a02f-4f1f-82fd-3c1ddca56dce tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "POST /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104/action" status: 202 len: 0 microversion: 2.1 time: 0.290337 Jun 15 00:45:27.406138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 295/625] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:45:27 2022] POST /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:45:27.415389 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:27.416157 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:27.423522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:27.423998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:27.424779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:27.425197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:27.554330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:27.561915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f0ced554-eb94-49b5-a48a-a6369de60d01 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.150946 Jun 15 00:45:27.562469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 331/626] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:27 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:28.579571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:28.580309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:28.587268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:28.587717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:28.588499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:28.588932 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:28.718828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:28.726782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4432f23b-ff2f-4484-9c95-1f55ad23fafe tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.151457 Jun 15 00:45:28.727336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 296/627] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:28 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:29.565955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:29.566463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:29.572912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.573385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:29.574170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.574597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:29.601143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:45:29.744056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:29.744655 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:29.751416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.751855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:29.752623 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.753050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:29.881451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-89e956a7-4804-4f56-a9a4-68129fe7dd41 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 204 len: 0 microversion: 2.1 time: 0.319475 Jun 15 00:45:29.882076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 332/628] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:45:29 2022] DELETE /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:45:29.890577 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:29.890921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:29.891602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:29.897531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.897852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0b72e64e-f34f-442b-95de-745e4a7d45b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.157599 Jun 15 00:45:29.898060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:29.898400 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 297/629] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:29 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:29.898699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:29.899120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:30.029725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:30.037155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-97d20c0c-a244-4117-93c0-2d11fcf24515 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1508 microversion: 2.1 time: 0.150794 Jun 15 00:45:30.037714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 333/630] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:29 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:30.914685 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:30.915287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:30.921776 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:30.922260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:30.923024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:30.923452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:31.049095 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:31.053884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:31.054483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:31.056607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3c01259f-1b29-435a-b86a-ff6fe1638790 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.145723 Jun 15 00:45:31.056904 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:31.057175 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 298/631] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:30 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:31.061507 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:31.069296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:31.069296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:31.069296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:31.187651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:31.195352 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7449252f-1fa5-4714-b912-a9986339483d tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1508 microversion: 2.1 time: 0.145194 Jun 15 00:45:31.195932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 334/632] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:31 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:32.073830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:32.074464 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:32.081382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:32.081827 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:32.082582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:32.083010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:32.212403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:32.212607 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:32.213363 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:32.220296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:32.220498 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bbda7780-803e-4835-a651-fb4c20a66d33 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.150498 Jun 15 00:45:32.220733 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:32.221059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 299/633] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:32 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:32.221481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:32.221905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:32.345956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:32.353433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d2aeee82-91eb-4d39-ae3d-7b1d5984237a tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1508 microversion: 2.1 time: 0.144643 Jun 15 00:45:32.353997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 335/634] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:32 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:33.083847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-ccf4e559-c37d-41c0-856f-e5e0926e5fea req-9594f3ac-7ece-4422-b692-4a8cb3f81753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4981f4e2-08fe-49bd-a96a-b53e858e6fa3", "name": "network-vif-deleted", "tag": "b05877eb-6abf-4037-85ad-714570af0aad"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:33.093727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ccf4e559-c37d-41c0-856f-e5e0926e5fea req-9594f3ac-7ece-4422-b692-4a8cb3f81753 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:33.094283 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ccf4e559-c37d-41c0-856f-e5e0926e5fea req-9594f3ac-7ece-4422-b692-4a8cb3f81753 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:33.105621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-ccf4e559-c37d-41c0-856f-e5e0926e5fea req-9594f3ac-7ece-4422-b692-4a8cb3f81753 service nova] Creating event network-vif-deleted:b05877eb-6abf-4037-85ad-714570af0aad for instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 on hv-cinder-84517 Jun 15 00:45:33.111231 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-ccf4e559-c37d-41c0-856f-e5e0926e5fea req-9594f3ac-7ece-4422-b692-4a8cb3f81753 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Jun 15 00:45:33.111899 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 300/635] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:33.237323 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:33.237912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:33.245497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:33.245497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:33.245497 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:33.245918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:33.249726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:33.377989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:33.377989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:33.378265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:33.383626 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:33.384416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:33.385403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a3d6569e-5f16-4f94-995e-1ce26ca876b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.152457 Jun 15 00:45:33.385549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:33.386010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:33.386197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 336/636] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:33 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:33.458351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:33.466428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-47f918de-7e86-4e82-bc87-d7137ee4a159 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 200 len: 1292 microversion: 2.1 time: 0.095818 Jun 15 00:45:33.467010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 301/637] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:33 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:34.402757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:34.403353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:34.410417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.410854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.411603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.412053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.483347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:34.483997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: 4981f4e2-08fe-49bd-a96a-b53e858e6fa3] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:34.490598 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.491047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.491803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.492267 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.506079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] HTTP exception thrown: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Request method failure captured: Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 HTTP/1.1 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp6FerWeLuXsL_HulJ96wnm6NE0Rq3zf3omo9rkXGGvCB2ssQqm5WyRzI7WugYX27UaFxAyu8yzbGtNntz1VIR1LLTnRHD4CzIKgY9f0RHkOnrAVSzGw8l82C7w_8b44rmnXpdxqECdw5ZM6f7EfLqq6nrAy2txzEPhWP0qllabxcE Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:45:34.507714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdef82f627f42b29f6da17f6bad6dd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdef82f627f42b29f6da17f6bad6dd4"}]}] Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4989693e66c44d6a8e5f8543f1b9c516 Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. Jun 15 00:45:34.509061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '4981f4e2-08fe-49bd-a96a-b53e858e6fa3'} Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:45:34.509782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. Jun 15 00:45:34.510949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:34.512007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Returning 404 to user: Instance 4981f4e2-08fe-49bd-a96a-b53e858e6fa3 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:45:34.512007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-86be0f42-db49-4ab5-8b7e-a01bf0bdb1de tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3" status: 404 len: 111 microversion: 2.1 time: 0.029604 Jun 15 00:45:34.512007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 302/638] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:34 2022] GET /compute/v2.1/servers/4981f4e2-08fe-49bd-a96a-b53e858e6fa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:45:34.517953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:34.518486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:34.527122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.527564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.528343 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.528771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.541742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:34.549970 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e8d596b4-c5e7-4ade-9e7e-24d32e647ec2 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.151068 Jun 15 00:45:34.550539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 337/639] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:34 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:34.554323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:45:34.800935 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-11353b51-cfe8-428c-a58b-7359b24df1fa tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 204 len: 0 microversion: 2.1 time: 0.286615 Jun 15 00:45:34.806888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 303/640] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:45:34 2022] DELETE /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 00:45:34.809376 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:34.809972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:34.815953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.816397 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.817143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:34.817568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:34.943445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:34.950813 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b6f11782-f841-42cf-83a6-5729f555b87b tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.145202 Jun 15 00:45:34.951366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 338/641] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:34 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:35.567802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:35.568522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:35.574862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:35.575295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:35.576070 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:35.576583 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:35.594347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:35.711470 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:35.718768 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e5e0796f-3904-4c8a-8f58-fbb99f3d7d6c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.155655 Jun 15 00:45:35.719332 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 304/642] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:35 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:35.967696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:35.968322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:35.974642 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:35.975078 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:35.975892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:35.976340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:36.101883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:36.109277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ae3727a8-11c3-4942-9cfe-152988914c4e tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.145363 Jun 15 00:45:36.110315 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 339/643] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:35 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:36.736246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:36.736824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:36.743303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:36.743759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:36.744551 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:36.744987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:36.880256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:36.888272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e0d14eac-c048-4161-b832-87225f59a2b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.156235 Jun 15 00:45:36.888831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 305/644] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:36 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:37.126787 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:37.127388 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:37.133984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:37.134453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:37.135929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:37.136368 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:37.263684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:37.271737 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-784db6cb-99ee-49b8-a8f4-5a5fe6cb2988 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.149290 Jun 15 00:45:37.278160 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 340/645] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:37 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:37.905823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:37.906440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:37.913399 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:37.913836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:37.914576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:37.915000 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:38.041442 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:38.048839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a3b4aace-4c63-4cff-b053-f0e71b62e2b6 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.146860 Jun 15 00:45:38.049391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 306/646] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:37 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:38.293046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:38.293644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:38.300155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:38.300605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:38.303891 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:38.303891 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:38.431796 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:38.439796 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5db430ab-9b54-464e-a3b7-2cec4adb3899 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1521 microversion: 2.1 time: 0.150526 Jun 15 00:45:38.441131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 341/647] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:38 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:39.066375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:39.066979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:39.074079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:39.074530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:39.075311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:39.075741 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:39.288005 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:39.295851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c6ceda4a-cd73-4fdc-a860-8cccae515760 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.233870 Jun 15 00:45:39.296432 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 307/648] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:39 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:39.450019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-0b9d9603-2a3c-4139-9465-cfc0c5f54561 req-845a14e5-c121-4753-81f4-3561473fd8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6969bf2-cd90-4330-8d7f-bcc914245566", "name": "network-vif-deleted", "tag": "d4ebf932-461b-49a7-aac4-453557dda2ea"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:39.455896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:39.456521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:39.458780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b9d9603-2a3c-4139-9465-cfc0c5f54561 req-845a14e5-c121-4753-81f4-3561473fd8fe service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:39.459221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-0b9d9603-2a3c-4139-9465-cfc0c5f54561 req-845a14e5-c121-4753-81f4-3561473fd8fe service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:39.462892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:39.463522 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:39.464492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:39.465088 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:39.471003 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-0b9d9603-2a3c-4139-9465-cfc0c5f54561 req-845a14e5-c121-4753-81f4-3561473fd8fe service nova] Creating event network-vif-deleted:d4ebf932-461b-49a7-aac4-453557dda2ea for instance f6969bf2-cd90-4330-8d7f-bcc914245566 on hv-cinder-84517 Jun 15 00:45:39.476083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-0b9d9603-2a3c-4139-9465-cfc0c5f54561 req-845a14e5-c121-4753-81f4-3561473fd8fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029631 Jun 15 00:45:39.476898 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 342/649] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:39.535961 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:39.544173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ad8aae3a-9826-4c3c-8eb8-7e873cda8d98 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1479 microversion: 2.1 time: 0.092053 Jun 15 00:45:39.544767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 308/650] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:39 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1479 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:40.314988 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:40.315678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:40.321987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:40.322425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:40.323182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:40.323602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:40.447673 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:40.455250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-71d60530-77ab-40cb-9660-fd621c8d5edf tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.145051 Jun 15 00:45:40.455844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 343/651] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:40 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:40.560647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:40.561242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:40.568385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:40.568766 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:40.569508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:40.569929 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:40.628736 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:40.635930 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aa79b106-56ea-45cb-a1ab-a62935b771c2 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1479 microversion: 2.1 time: 0.079068 Jun 15 00:45:40.636485 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 309/652] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:40 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1479 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:41.472147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:41.472736 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:41.480547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:41.480991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:41.481735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:41.482226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:41.612630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:41.621162 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f9267b31-479a-4aad-9963-cb5ef80c209b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.152774 Jun 15 00:45:41.621864 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 344/653] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:41 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:41.652228 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:41.652837 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:41.660610 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:41.661298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:41.662090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:41.662524 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:41.694483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:41.694929 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:41.695370 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lazy-loading 'fault' on Instance uuid f6969bf2-cd90-4330-8d7f-bcc914245566 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:45:41.735759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4989693e66c44d6a8e5f8543f1b9c516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdef82f627f42b29f6da17f6bad6dd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:41.743349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d97c822d-2e1a-4e09-a154-af4494c7e58c tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 200 len: 1311 microversion: 2.1 time: 0.095017 Jun 15 00:45:41.743920 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 310/654] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:41 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:42.638897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:42.639495 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:42.646490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.646932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:42.647684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.648144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:42.769196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:42.769782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] [instance: f6969bf2-cd90-4330-8d7f-bcc914245566] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:42.776257 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.776705 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:42.777462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.777891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:42.778278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:42.786388 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-06564a7d-6e1a-47c1-a421-8bb48a15d9dc tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1510 microversion: 2.1 time: 0.151795 Jun 15 00:45:42.786972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 345/655] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:42 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:42.791721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] HTTP exception thrown: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Request method failure captured: Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 HTTP/1.1 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp6FerWeLuXsL_HulJ96wnm6NE0Rq3zf3omo9rkXGGvCB2ssQqm5WyRzI7WugYX27UaFxAyu8yzbGtNntz1VIR1LLTnRHD4CzIKgY9f0RHkOnrAVSzGw8l82C7w_8b44rmnXpdxqECdw5ZM6f7EfLqq6nrAy2txzEPhWP0qllabxcE Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:45:42.793379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bcdef82f627f42b29f6da17f6bad6dd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bcdef82f627f42b29f6da17f6bad6dd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bcdef82f627f42b29f6da17f6bad6dd4"}]}] Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: bcdef82f627f42b29f6da17f6bad6dd4 Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2052960179 Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 4989693e66c44d6a8e5f8543f1b9c516 Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2052960179-project Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. Jun 15 00:45:42.794891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': 'f6969bf2-cd90-4330-8d7f-bcc914245566'} Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:45:42.795586 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. Jun 15 00:45:42.796732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:45:42.798356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] Returning 404 to user: Instance f6969bf2-cd90-4330-8d7f-bcc914245566 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:45:42.798356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-abccdb15-4ba9-4af1-b797-51b2d28da2b0 tempest-ServerRescueNegativeTestJSON-2052960179 tempest-ServerRescueNegativeTestJSON-2052960179-project] 10.222.0.17 "GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566" status: 404 len: 111 microversion: 2.1 time: 0.030689 Jun 15 00:45:42.798356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 311/656] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:42 2022] GET /compute/v2.1/servers/f6969bf2-cd90-4330-8d7f-bcc914245566 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:45:42.802432 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:42.803060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:42.809312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.809760 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:42.810517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:42.810948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:43.094231 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-919665cc-8107-4611-8de8-29863d54455d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "POST /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104/action" status: 202 len: 0 microversion: 2.1 time: 0.295620 Jun 15 00:45:43.094861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 346/657] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:45:42 2022] POST /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 00:45:43.103060 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:43.103668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:43.112153 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:43.112620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:43.113395 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:43.113832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:43.260569 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:43.269604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c2251839-04de-4919-90f4-c97d6ba5f87f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1518 microversion: 2.1 time: 0.170304 Jun 15 00:45:43.270176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 312/658] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:43 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:45:43.370182 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-bc3d796d-ad86-489b-a040-cc7851557b7f req-9586cfd2-6f34-49dd-bae8-67470e311701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:43.379750 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-bc3d796d-ad86-489b-a040-cc7851557b7f req-9586cfd2-6f34-49dd-bae8-67470e311701 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:43.380314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-bc3d796d-ad86-489b-a040-cc7851557b7f req-9586cfd2-6f34-49dd-bae8-67470e311701 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:43.391639 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.compute.server_external_events [req-bc3d796d-ad86-489b-a040-cc7851557b7f req-9586cfd2-6f34-49dd-bae8-67470e311701 service nova] Unable to find a host for instance c697d7d3-580e-4230-9460-8e6718bab104. Dropping event network-vif-unplugged {{(pid=124683) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 00:45:43.392619 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-bc3d796d-ad86-489b-a040-cc7851557b7f req-9586cfd2-6f34-49dd-bae8-67470e311701 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026444 Jun 15 00:45:43.393371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 347/659] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 00:45:44.103370 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:44.104505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:44.111844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:44.112318 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:44.113113 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:44.113546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:44.137936 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4331bb8d-e596-4c1e-b5ea-194da55ee7fd tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/ips" status: 200 len: 152 microversion: 2.20 time: 0.114515 Jun 15 00:45:44.138987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 313/660] 10.222.0.17 () {60 vars in 1288 bytes} [Wed Jun 15 00:45:44 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/ips => generated 152 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:45:44.286585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:44.287806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:44.294215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:44.294605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:44.295354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:44.295779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:44.428629 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:44.437271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81892d61-d58d-4546-9448-d6c8f57ff090 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1518 microversion: 2.1 time: 0.154455 Jun 15 00:45:44.446968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 348/661] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:44 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:45.458304 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:45.458912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:45.471785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:45.472143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:45.472994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:45.473347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:45.477452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:45.478036 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:45.484364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:45.485435 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:45.486210 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:45.486647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:45.515223 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-74abd0cc-b394-4777-b2f5-29dc96ee6f5f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/ips" status: 200 len: 146 microversion: 2.1 time: 0.112528 Jun 15 00:45:45.516347 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 314/662] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:45:45 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/ips => generated 146 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:45.647674 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:45.657892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aaa1b38f-4a8a-4cab-b869-3e8f967e37ed tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1520 microversion: 2.1 time: 0.206551 Jun 15 00:45:45.663686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 349/663] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:45 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:46.676538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:46.677242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:46.684096 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:46.684547 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:46.685304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:46.685743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:46.821575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:46.829138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-540a34cc-6473-4032-91ca-856acbafb08b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.157257 Jun 15 00:45:46.829700 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 315/664] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:46 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:47.174984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6463caed-4a98-4333-bd70-670da114b63c"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:47.176140 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:47.182808 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.183371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:47.184247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.184752 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:47.487622 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:45:47.488173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:47.494219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.499015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:47.499015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.499015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:47.522181 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'flavor' on Instance uuid 69a7e579-cb51-4e24-9c35-ddf29ebffe0d {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:45:47.897790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ed870b56-f6ae-482e-a08e-247e8ab68575 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726459 Jun 15 00:45:47.898459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 350/665] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:45:47 2022] POST /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:47.910459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:47.911311 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:47.920528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.921421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:47.922856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:47.924235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:48.076069 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:48.078400 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:48.084231 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ffdb75f0-7944-46ae-88b3-b8d3d208e819 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.179923 Jun 15 00:45:48.084801 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 351/666] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:47 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:48.113452 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a12177a-a71b-4c59-9f96-c66c61fd369b tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/action" status: 202 len: 0 microversion: 2.20 time: 0.629560 Jun 15 00:45:48.114182 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 316/667] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jun 15 00:45:47 2022] POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 00:45:48.123116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:48.125999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:48.131097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:48.131989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:48.132480 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:48.132975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:48.541193 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:48.549399 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:48.550888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:48.552070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f2d0dfbb-4a7e-4b72-8c95-99fe63e37e96 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.433762 Jun 15 00:45:48.552626 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 352/668] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:48 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:45:49.102132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:49.103014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:49.109282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:49.109727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:49.110477 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:49.110972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:49.242653 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:49.249934 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d4b32237-604d-4535-90b5-11a7fa3d80b1 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.152515 Jun 15 00:45:49.251223 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 317/669] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:49 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:49.570404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:49.571018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:49.577518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:49.577992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:49.578768 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:49.579198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:49.710357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:49.718390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:49.720711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:49.721815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e828df48-5306-4782-bdb2-17e2e67e2eed tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.155263 Jun 15 00:45:49.722415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 353/670] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:49 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:50.268240 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:50.268862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:50.275545 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:50.276051 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:50.279456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:50.279456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:50.403290 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:50.410753 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-dd77abb7-5416-4c6a-bfd9-735fa8805ec8 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.146932 Jun 15 00:45:50.411333 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 318/671] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:50 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:50.740308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:50.740907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:50.747408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:50.747842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:50.748613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:50.749040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:50.872985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:50.882128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:50.883640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:50.884891 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cd9af2f6-1b46-49a9-8c2c-43a927e3129a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.148336 Jun 15 00:45:50.885458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 354/672] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:50 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:51.427445 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:51.428074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:51.434399 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:51.434838 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:51.435594 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:51.436059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:51.566137 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:51.573533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4d74e5e0-a3d1-4301-b865-8721af71ad55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.149971 Jun 15 00:45:51.574092 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 319/673] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:51 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:51.902983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:51.903576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:51.910588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:51.910966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:51.911704 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:51.912302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:52.036559 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:52.044442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:52.045921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:52.047697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-89c4b242-60b2-4b79-87c3-e2bb7a30d880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.147973 Jun 15 00:45:52.048320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 355/674] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:51 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:52.590390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:52.590993 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:52.597111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:52.597559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:52.598312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:52.598747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:52.602712 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:52.733178 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:52.741129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2b1fe395-3214-4277-b509-49d52a9f3c55 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.154427 Jun 15 00:45:52.741948 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 320/675] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:52 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:53.065341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:53.065966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:53.072445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:53.072907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:53.073686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:53.074109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:53.202192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:53.210780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:53.212285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:53.213426 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-137d83f8-1380-42f9-8ce4-cc345b5007d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.152025 Jun 15 00:45:53.213971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 356/676] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:53 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:53.758971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:53.759572 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:53.761896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:53.767429 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:53.767873 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:53.768700 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:53.769085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:53.904064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:53.912696 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3f5a3d5f-2c2f-4a89-9af0-c04f64fa6e48 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.157576 Jun 15 00:45:53.913251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 321/677] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:53 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:54.231089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:54.231690 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:54.238687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:54.239122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:54.239861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:54.240312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:54.369327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:54.377070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:54.378548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:54.379678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cd70397f-a463-4266-8c9d-9e2f4d6f0cf4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.152341 Jun 15 00:45:54.380265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 357/678] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:54 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:54.929494 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:54.930126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:54.936558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:54.936999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:54.938247 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:54.938680 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:55.065231 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:55.072862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f08e8d1c-7d26-4b8e-a895-3253935ffa4f tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.147241 Jun 15 00:45:55.073415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 322/679] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:54 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:55.397601 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:55.398196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:55.404532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:55.404961 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:55.405699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:55.406122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:55.537729 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:55.545535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:55.547015 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:55.548183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-61cc5d9b-55eb-49b3-b680-cfb01669e930 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.154328 Jun 15 00:45:55.548758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 358/680] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:55 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:56.090259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:56.090863 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:56.097188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:56.097638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:56.098385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:56.098816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:56.225123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:56.232532 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-50fc78d9-9373-4376-aa3f-e9cadbbf7b87 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.146093 Jun 15 00:45:56.233268 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 323/681] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:56 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:56.566220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:56.566839 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:56.573416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:56.573856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:56.574602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:56.575026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:56.702357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:56.710227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:56.711754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:56.712931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1ea0f009-e756-438a-8007-fd0f45c8bf2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.150746 Jun 15 00:45:56.713485 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 359/682] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:56 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:57.249842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:57.250438 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:57.257418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:57.257860 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:57.258604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:57.259028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:57.395955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:57.403806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-de5e8d57-6aa8-4c06-ae74-b33f4068837b tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.157857 Jun 15 00:45:57.404411 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 324/683] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:57 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:57.736624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:57.738502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:57.746343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:57.749395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:57.749395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:57.749395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:57.877573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:57.885462 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:57.886937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:57.888395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-efe5594b-a707-4234-bce8-a208d1ec5d2f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.158444 Jun 15 00:45:57.888956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 360/684] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:57 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:58.422403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:58.423055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:58.429484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.429927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.430677 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.431109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.567725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:58.581078 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1b8b01f9-7cc9-4f47-9c70-995a8d89b002 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.157295 Jun 15 00:45:58.581078 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 325/685] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:58 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:45:58.602973 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:58.603948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:58.610127 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.611679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.611679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.611868 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.640673 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-af8a31d2-db0f-4374-a98a-efa06b1947dc tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041546 Jun 15 00:45:58.644684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 361/686] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:45:58 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:58.651681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:58.652207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:58.658166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.658611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.659365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.659833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.686883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ed993a78-ced0-4057-b5a3-d0364e8dd500 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c" status: 200 len: 194 microversion: 2.1 time: 0.039061 Jun 15 00:45:58.687375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 326/687] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jun 15 00:45:58 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:45:58.906512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:58.907146 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:58.913700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.914149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:58.914900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:58.915329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:59.043503 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:59.053159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:59.054651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:59.055818 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-da190763-d3ba-49b9-96af-002024ec7eb3 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1744 microversion: 2.20 time: 0.153155 Jun 15 00:45:59.056410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 362/688] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:45:58 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:45:59.595277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:45:59.595877 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:45:59.602445 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:59.602889 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:59.603639 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:45:59.604101 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:45:59.738813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:45:59.746378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6166dd51-ffd3-47aa-a95c-e862d38b16cb tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.154897 Jun 15 00:45:59.750035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 327/689] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:45:59 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:00.074605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:00.075226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:00.081831 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.082271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.083026 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.083454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.211972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:00.220454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:00.222023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:00.223219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1801a78a-fc21-4ac2-b553-159dbd327097 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1744 microversion: 2.20 time: 0.152583 Jun 15 00:46:00.223770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 363/690] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:00 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:00.250847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffa6b51f-b02a-4260-9cba-1311965368a3"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:00.251972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:00.258050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.258485 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.259265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.259692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.763700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:00.764406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:00.771052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.771499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.772271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:00.772698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:00.904031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:00.911816 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-74dc1cef-ccb8-4878-acef-fb3493e54a5d tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.152252 Jun 15 00:46:00.914249 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 364/691] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:00 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:01.069158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-552d53bb-3120-4e70-8505-37482ae3ad00 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "POST /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821972 Jun 15 00:46:01.069761 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 328/692] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:46:00 2022] POST /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:01.241814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:01.242440 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:01.245507 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=64 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:01.250359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:01.252036 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:01.253038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:01.253766 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:01.412209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:01.431983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:01.434834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:01.436271 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a9883493-04f0-417e-a0d1-e99edb659748 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.198235 Jun 15 00:46:01.437301 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 365/693] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:01 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:01.835544 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-ade3fa61-4034-4bba-a5dc-284519531f7f req-f40f49e1-1cfe-4ebe-9029-7dbc83da5982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "name": "network-vif-plugged", "status": "completed", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:01.851281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ade3fa61-4034-4bba-a5dc-284519531f7f req-f40f49e1-1cfe-4ebe-9029-7dbc83da5982 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:01.852308 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-ade3fa61-4034-4bba-a5dc-284519531f7f req-f40f49e1-1cfe-4ebe-9029-7dbc83da5982 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:01.875839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-ade3fa61-4034-4bba-a5dc-284519531f7f req-f40f49e1-1cfe-4ebe-9029-7dbc83da5982 service nova] Creating event network-vif-plugged:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:46:01.909576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-ade3fa61-4034-4bba-a5dc-284519531f7f req-f40f49e1-1cfe-4ebe-9029-7dbc83da5982 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237752 Jun 15 00:46:01.911722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 329/694] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:01.934616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:01.934616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:01.939669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:01.941130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:01.942114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:01.942594 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:02.113130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:02.122822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b0f83b06-fe29-444a-87bb-1ae32ee4dd45 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.196970 Jun 15 00:46:02.124341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 366/695] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:01 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:02.458030 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:02.459312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:02.465571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:02.466016 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:02.466913 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:02.467654 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:02.621396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:02.636664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:02.638621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:02.639818 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-99bce723-5684-4c50-8730-0ec7b900da04 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.186290 Jun 15 00:46:02.642397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 330/696] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:02 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:03.142205 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:03.143175 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:03.149652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:03.150176 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:03.150997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:03.151491 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:03.348475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:03.363416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-84536397-31f6-43e0-a932-155f2fd44d09 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1576 microversion: 2.1 time: 0.225779 Jun 15 00:46:03.366648 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 367/697] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:03 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:03.660691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:03.661979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:03.672425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:03.674878 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:03.674878 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:03.675968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:03.879261 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:03.891995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:03.893817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:03.895179 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9de7d288-a748-4c54-a787-d639ed0c7467 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.239193 Jun 15 00:46:03.896340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 331/698] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:03 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:03.926777 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-dafcebe3-3f1a-4f2f-a6a2-7d39fce9c390 req-08d5420e-6533-43b6-9088-2388953b8a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:03.935490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-dafcebe3-3f1a-4f2f-a6a2-7d39fce9c390 req-08d5420e-6533-43b6-9088-2388953b8a48 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:03.935961 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-dafcebe3-3f1a-4f2f-a6a2-7d39fce9c390 req-08d5420e-6533-43b6-9088-2388953b8a48 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:03.948985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-dafcebe3-3f1a-4f2f-a6a2-7d39fce9c390 req-08d5420e-6533-43b6-9088-2388953b8a48 service nova] Creating event network-vif-plugged:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:46:03.954289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-dafcebe3-3f1a-4f2f-a6a2-7d39fce9c390 req-08d5420e-6533-43b6-9088-2388953b8a48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031038 Jun 15 00:46:03.955206 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 368/699] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:04.385875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:04.386593 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:04.405363 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:04.406547 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:04.408181 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:04.408964 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:04.566875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:04.576316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5045081a-3226-4c6f-8d68-8650af23ad05 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1563 microversion: 2.1 time: 0.195601 Jun 15 00:46:04.577396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 332/700] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:04 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:04.915633 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:04.916343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:04.923556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:04.924037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:04.924847 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:04.925336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:04.928000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=100 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:05.067605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:05.067605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:05.067833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:05.067833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-145e165b-5d53-4b85-a77d-1a6c7a30304a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.156998 Jun 15 00:46:05.068567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 369/701] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:04 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:06.086777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:06.090975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:06.099114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:06.099663 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:06.100539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:06.101330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:06.294420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:06.305028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:06.306588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:06.307744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bcaca087-4f38-4132-a1e7-750d38844b16 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.225358 Jun 15 00:46:06.319146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 333/702] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:06 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:07.330596 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:07.331193 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:07.339062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:07.339506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:07.340305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:07.340739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:07.508975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:07.520859 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:07.522623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:07.524389 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4eb441fe-9e73-4422-91f9-2d25a7b591e8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.198840 Jun 15 00:46:07.526652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 370/703] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:07 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:08.544955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:08.545850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:08.554729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:08.555187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:08.556286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:08.556897 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:08.746596 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:08.755407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:08.756919 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:08.758120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c5213f66-1ebd-42d4-9f91-c64077bb5a4d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.217064 Jun 15 00:46:08.759958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 334/704] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:08 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:46:09.784215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:09.784215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:09.788582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:09.789725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:09.792098 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:09.792822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:09.816177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:09.817143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:09.826557 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:09.827298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:09.828319 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:09.829443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:09.863255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1ab22982-852b-4c57-b8b2-80c768edee71 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051042 Jun 15 00:46:09.870754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 335/705] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:46:09 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:46:09.957261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:09.965957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:09.967548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:09.971897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0cfe8625-cc88-4a30-8da1-724e185c7cf1 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.196944 Jun 15 00:46:09.983317 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 371/706] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:09 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:10.041200 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:10.042038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:10.048418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:10.049119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:10.050111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:10.050760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:10.056967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:10.086031 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4fb6307a-a254-43c2-b72f-4bc7a723f28a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c" status: 200 len: 194 microversion: 2.1 time: 0.048667 Jun 15 00:46:10.086730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 336/707] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jun 15 00:46:10 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:10.097862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:10.098615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:10.105009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:10.105526 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:10.106278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:10.106833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:10.206624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lazy-loading 'services' on Instance uuid 5359c5e5-5c3a-4c52-8e2f-142553746c5c {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:46:10.406757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bb6c8f53-f3cb-43c8-948b-d520df410c6e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c" status: 202 len: 0 microversion: 2.1 time: 0.313761 Jun 15 00:46:10.412589 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 372/708] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:46:10 2022] DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/6463caed-4a98-4333-bd70-670da114b63c => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:46:10.991531 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:10.992074 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:10.998549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:10.998982 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:10.999721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:11.000175 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:11.132413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:11.140454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:11.142471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:11.143611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-61b0154f-132d-41de-92c7-fb50aa40ad48 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.156307 Jun 15 00:46:11.144192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 337/709] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:10 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:12.162208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:12.162940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:12.169703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:12.170148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:12.170886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:12.171308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:12.308556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:12.317102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:12.318930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:12.320120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-78988bd5-cc4a-4a75-914c-44cc8d752575 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1739 microversion: 2.20 time: 0.162192 Jun 15 00:46:12.320778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 373/710] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:12 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:13.338759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:13.339469 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:13.346760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.347262 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.348116 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.348554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.487336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:13.496201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:13.497688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:13.498833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b0cc4313-8923-48ee-a2a6-506af2531590 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1721 microversion: 2.20 time: 0.164127 Jun 15 00:46:13.499383 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 338/711] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:13 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:46:13.667792 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:13.668420 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:13.679532 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.680011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.680783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.681218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.712972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ce2d7e9-e5ce-4166-ad0d-10eadf00f174 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/ffa6b51f-b02a-4260-9cba-1311965368a3" status: 200 len: 194 microversion: 2.1 time: 0.049061 Jun 15 00:46:13.713881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 374/712] 10.222.0.17 () {58 vars in 1412 bytes} [Wed Jun 15 00:46:13 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/ffa6b51f-b02a-4260-9cba-1311965368a3 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:13.723851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:13.724366 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:13.730254 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.730699 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.731448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:13.731875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:13.820057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lazy-loading 'services' on Instance uuid 5359c5e5-5c3a-4c52-8e2f-142553746c5c {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:46:14.023010 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d4b02352-4d03-42ef-a1b7-51fa388e3fa0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/ffa6b51f-b02a-4260-9cba-1311965368a3" status: 202 len: 0 microversion: 2.1 time: 0.302808 Jun 15 00:46:14.023516 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 339/713] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:46:13 2022] DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments/ffa6b51f-b02a-4260-9cba-1311965368a3 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:46:14.519990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:14.520611 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:14.526473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:14.526909 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:14.527643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:14.528096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:14.654798 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:14.663100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:14.664650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:14.665779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f8068814-8ef7-4f9d-bb21-bd7f6a894bf5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1721 microversion: 2.20 time: 0.149745 Jun 15 00:46:14.666327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 375/714] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:14 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:15.685460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:15.686154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:15.692425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:15.692875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:15.693632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:15.694067 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:15.820654 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:15.828367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:15.830512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:15.831661 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-997003de-5c40-45e5-80af-b70fb2a4acf0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1721 microversion: 2.20 time: 0.150923 Jun 15 00:46:15.832241 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 340/715] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:15 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:16.850094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:16.850699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:16.857021 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:16.857456 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:16.858198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:16.858620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:16.984676 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:16.993022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:16.994547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:16.995689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2d4fa0e-906c-488f-a4f6-cccdc7820e60 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1721 microversion: 2.20 time: 0.149539 Jun 15 00:46:16.996282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 376/716] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:16 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:17.436866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-4f4562c3-8da5-42af-8f07-d43044829aa8 req-ccb793b8-f118-4516-bfc7-218461efb0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "name": "network-vif-unplugged", "status": "completed", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:17.445818 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4f4562c3-8da5-42af-8f07-d43044829aa8 req-ccb793b8-f118-4516-bfc7-218461efb0df service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:17.446254 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4f4562c3-8da5-42af-8f07-d43044829aa8 req-ccb793b8-f118-4516-bfc7-218461efb0df service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:17.457311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-4f4562c3-8da5-42af-8f07-d43044829aa8 req-ccb793b8-f118-4516-bfc7-218461efb0df service nova] Creating event network-vif-unplugged:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:46:17.462014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-4f4562c3-8da5-42af-8f07-d43044829aa8 req-ccb793b8-f118-4516-bfc7-218461efb0df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028915 Jun 15 00:46:17.462573 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 341/717] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:18.014187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:18.014797 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.021219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.021662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.022409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.022838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.159537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:18.167285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:18.168789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:18.169972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4e5864ce-759d-4bc4-a6b1-6f43844f543d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1724 microversion: 2.20 time: 0.159815 Jun 15 00:46:18.174106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 377/718] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:18 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:18.189684 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "624a4ca7-e548-4e64-a9e7-d95fd7164f93"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:18.190830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.197195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.197689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.198466 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.198921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.337804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:18.338775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.345465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.345899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.346740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.347161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.377718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-611d15dd-feca-4b6b-9916-4ea94d5b66e4 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043839 Jun 15 00:46:18.378447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 378/719] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:46:18 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 00:46:18.482691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:18.483599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.490122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.490558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.491306 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.491737 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.520565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-04bd3ce9-211f-4a1d-9d61-45c62aeb7b56 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041687 Jun 15 00:46:18.521159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 379/720] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:46:18 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 00:46:18.576861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:18.577338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.583745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.586108 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.586108 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.586108 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.616247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:46:18.926980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ce3ef39-88fa-428f-b576-f395d07c39df tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 204 len: 0 microversion: 2.1 time: 0.353573 Jun 15 00:46:18.932506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 380/721] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:46:18 2022] DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:46:18.935676 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:18.936385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:18.942775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.943218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:18.944023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:18.944453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:19.073489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:19.081629 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0d7340ce-2d1f-4608-9489-6d2daf2751f1 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1672 microversion: 2.1 time: 0.149834 Jun 15 00:46:19.082209 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 381/722] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:18 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:19.097705 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-054febd5-a7a5-4a4d-bd40-23911a33d72f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.912344 Jun 15 00:46:19.099581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 342/723] 10.222.0.17 () {62 vars in 1363 bytes} [Wed Jun 15 00:46:18 2022] POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments => generated 188 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 00:46:19.213528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:19.214009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:19.220076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:19.222745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:19.222745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:19.222745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:19.307479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:19.760296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e3ecee11-a3aa-4f46-96b0-c6c3eae43ee0 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments/624a4ca7-e548-4e64-a9e7-d95fd7164f93" status: 202 len: 0 microversion: 2.20 time: 0.550578 Jun 15 00:46:19.760966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 382/724] 10.222.0.17 () {60 vars in 1456 bytes} [Wed Jun 15 00:46:19 2022] DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments/624a4ca7-e548-4e64-a9e7-d95fd7164f93 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:46:19.822775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:19.823504 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:19.829958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:19.830400 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:19.831142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:19.831568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:20.002406 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ccc2cf56-8e51-4944-adf3-ca048f6c55c6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/action" status: 202 len: 0 microversion: 2.20 time: 0.183528 Jun 15 00:46:20.002999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 343/725] 10.222.0.17 () {62 vars in 1318 bytes} [Wed Jun 15 00:46:19 2022] POST /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:46:20.011166 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:20.012033 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:20.020053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:20.020487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:20.021410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:20.021832 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:20.100196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:20.101272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:20.107312 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:20.107961 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:20.108835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:20.109397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:20.164593 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:20.172748 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:20.174359 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:20.175560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8711d73c-0441-4c3f-bdc2-aa3aa5176986 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1672 microversion: 2.20 time: 0.168430 Jun 15 00:46:20.176139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 383/726] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:20 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:20.247878 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:20.255722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-44e58df5-e10b-4969-aba0-87ccaad1515f tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1672 microversion: 2.1 time: 0.160720 Jun 15 00:46:20.265352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 344/727] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:20 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:21.193897 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:21.194477 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:21.201040 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:21.201484 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:21.202235 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:21.202662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:21.273155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:21.273785 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:21.280222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:21.280677 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:21.281469 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:21.281903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:21.340016 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:21.348351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:21.349846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:21.350991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7fe62ad8-f94a-4f69-b200-f456b15c7880 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1672 microversion: 2.20 time: 0.160955 Jun 15 00:46:21.351554 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 384/728] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:21 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:21.423571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:21.431628 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1fb929c8-994a-45a6-813f-bd0119a00f22 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1672 microversion: 2.1 time: 0.162297 Jun 15 00:46:21.432227 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 345/729] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:21 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:22.369531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:22.370152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:22.376682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:22.377127 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:22.377884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:22.378319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:22.448595 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:22.449207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:22.456212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:22.456667 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:22.457431 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:22.457869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:22.514650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:22.525454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:22.526928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:22.528095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-42377010-d9e9-4fa0-a67c-ec1138970b71 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1672 microversion: 2.20 time: 0.162396 Jun 15 00:46:22.533631 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 385/730] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:22 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:22.599355 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:22.606722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-326c56c3-d969-490c-9a11-224a286d4866 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1672 microversion: 2.1 time: 0.161926 Jun 15 00:46:22.607286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 346/731] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:22 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:23.546394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:23.546997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:23.553549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:23.553997 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:23.554763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:23.555196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:23.624188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:23.624799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:23.635646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:23.635646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:23.635646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:23.635646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:23.727131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:23.736305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:23.738102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:23.744199 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cd4f6ddb-6898-44ca-a7a7-03db5287d2a8 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1674 microversion: 2.20 time: 0.199660 Jun 15 00:46:23.745892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 386/732] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:23 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:23.806542 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:23.815117 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-552618a8-c17e-400d-8834-6f64f610896a tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1672 microversion: 2.1 time: 0.194952 Jun 15 00:46:23.816307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 347/733] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:23 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:24.625279 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-63c2ee1c-639c-4034-8828-09b3afbab471 req-d238126e-5db8-4a02-b616-82132e2ff29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c5e5-5c3a-4c52-8e2f-142553746c5c", "name": "network-vif-deleted", "tag": "44ea47e2-3ec1-4b18-b3e1-c91beaccff1a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:24.640007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-63c2ee1c-639c-4034-8828-09b3afbab471 req-d238126e-5db8-4a02-b616-82132e2ff29d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.640007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-63c2ee1c-639c-4034-8828-09b3afbab471 req-d238126e-5db8-4a02-b616-82132e2ff29d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.656865 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-63c2ee1c-639c-4034-8828-09b3afbab471 req-d238126e-5db8-4a02-b616-82132e2ff29d service nova] Creating event network-vif-deleted:44ea47e2-3ec1-4b18-b3e1-c91beaccff1a for instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c on hv-cinder-84517 Jun 15 00:46:24.662457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-63c2ee1c-639c-4034-8828-09b3afbab471 req-d238126e-5db8-4a02-b616-82132e2ff29d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226944 Jun 15 00:46:24.663067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 387/734] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:24.769482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:24.769482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:24.769482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=56 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:24.789854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.793278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.795256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.796092 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.833049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:24.833841 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:24.846051 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.849396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.850528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.853331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.895837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:24.896553 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:24.897226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lazy-loading 'fault' on Instance uuid 5359c5e5-5c3a-4c52-8e2f-142553746c5c {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:46:24.986511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0bbb1f50c42acb50dac254a653da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f2ff4320764a69bb987d567aed9201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:24.996496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-91cf1e43-370c-4e1c-99bd-73e39d6d4089 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 200 len: 1326 microversion: 2.1 time: 0.167400 Jun 15 00:46:25.000023 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 388/735] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:24 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:46:25.113633 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:25.121882 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:25.123399 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:25.124746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0f62c998-694a-4cc5-8378-cd6497a584af tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.363951 Jun 15 00:46:25.125300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 348/736] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:24 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:26.016610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:26.017856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:26.025465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:26.025914 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:26.026977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:26.027410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:26.042218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c HTTP/1.1 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:46:26.044030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:26.045682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '5359c5e5-5c3a-4c52-8e2f-142553746c5c'} Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:46:26.046537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:26.048587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:26.050161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:46:26.050161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1c976159-9ec5-4116-9764-e44834d03c7d tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 404 len: 111 microversion: 2.1 time: 0.034996 Jun 15 00:46:26.050161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 389/737] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:26 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:26.054987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4c6d221c-4eee-4280-93a7-f39a03e29c7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '.version_select at 0x7fa81f6de160>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:26.139755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4c6d221c-4eee-4280-93a7-f39a03e29c7e tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17043167" status: 202 len: 0 microversion: 2.1 time: 0.088458 Jun 15 00:46:26.140511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 349/738] 10.222.0.17 () {58 vars in 1214 bytes} [Wed Jun 15 00:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17043167 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:46:26.142896 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:26.143572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:26.149764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:26.150217 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:26.150976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:26.151410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:26.354022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:26.364475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:26.365982 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:26.367120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f20a322f-397b-4b3d-b714-f2f5b9727572 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.228510 Jun 15 00:46:26.368149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 390/739] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:26 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:46:27.386872 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:27.387510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:27.395377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:27.395832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:27.396691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:27.397300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:27.403076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:27.538613 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:27.547453 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:27.549013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:27.550189 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0e07e5c0-0ef7-4af0-8ab9-3fee58360413 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.167500 Jun 15 00:46:27.550747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 350/740] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:27 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:28.570062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:28.570759 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:28.577525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:28.577967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:28.578723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:28.579153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:28.717445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:28.725805 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:28.727290 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:28.728590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a609233b-ac04-4594-92ef-61ff6c86866a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.162417 Jun 15 00:46:28.729145 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 391/741] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:28 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:29.752783 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:29.755022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:29.766576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:29.767560 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:29.768379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:29.769020 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:29.930098 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:29.940155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:29.941828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:29.943084 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4fda6c42-1c6c-44f2-9d52-36e44f935d4a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.199910 Jun 15 00:46:29.943638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 351/742] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:29 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:30.961980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:30.962517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:30.970344 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:30.970783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:30.971741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:30.972354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:31.134905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:31.147167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:31.162437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:31.164404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9d2fb290-5094-4d14-8971-98fe420f81e5 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.204405 Jun 15 00:46:31.165066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 392/743] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:30 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:31.665796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:31.667138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:31.674435 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:31.674925 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:31.675690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:31.676152 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:31.690806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c HTTP/1.1 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:46:31.692533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.694141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '5359c5e5-5c3a-4c52-8e2f-142553746c5c'} Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:46:31.694973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.696420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.698525 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:46:31.699407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6bd7db31-2796-499d-b146-ccd64a292dbd tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 404 len: 111 microversion: 2.1 time: 0.037705 Jun 15 00:46:31.700500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 352/744] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:46:31 2022] DELETE /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:31.709311 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:31.710174 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 5359c5e5-5c3a-4c52-8e2f-142553746c5c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:31.720383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:31.741540 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:31.741990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:31.742771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:31.743197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:31.770329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c HTTP/1.1 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:46:31.772464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.773937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '5359c5e5-5c3a-4c52-8e2f-142553746c5c'} Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:46:31.774713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. Jun 15 00:46:31.776149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:31.777568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 5359c5e5-5c3a-4c52-8e2f-142553746c5c could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:46:31.778494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5e615f4a-532a-41cf-a7ce-267e94521b66 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c" status: 404 len: 111 microversion: 2.1 time: 0.072932 Jun 15 00:46:31.779045 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 393/745] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:31 2022] GET /compute/v2.1/servers/5359c5e5-5c3a-4c52-8e2f-142553746c5c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:32.183953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:32.184554 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:32.191047 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:32.191483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:32.192262 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:32.192675 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:32.328459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:32.336438 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:32.337956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:32.339121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-46c5766b-c23a-4a31-a7ad-a1bd7aac5b40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.159026 Jun 15 00:46:32.339670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 353/746] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:32 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:33.358405 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:33.359024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:33.366614 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:33.367052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:33.367793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:33.368240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:33.496381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:33.504419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:33.505969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:33.507206 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2bbaafe-afbb-4964-8ce5-17d11fbbde09 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.153010 Jun 15 00:46:33.507771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 394/747] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:33 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:34.525994 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:34.526570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:34.532710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:34.533148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:34.533959 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:34.534385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:34.661875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:34.670190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:34.672664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:34.672901 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-71a5926b-a026-44eb-aca0-fdc79443c953 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.150768 Jun 15 00:46:34.673459 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 354/748] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:34 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:35.691649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:35.692190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:35.698711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:35.699140 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:35.699888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:35.700338 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:35.831284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:35.839180 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:35.840699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:35.841871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f29f47d8-5c08-4cd6-b234-9dc7b5ff555e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.154174 Jun 15 00:46:35.842420 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 395/749] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:35 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:36.861013 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:36.861771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:36.868861 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:36.869386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:36.870151 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:36.870582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:37.000803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:37.009214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:37.010939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:37.012188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-aec25ec3-c109-4aa0-b87d-9e3f50001172 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.155184 Jun 15 00:46:37.012858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 355/750] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:36 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 00:46:37.220325 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:37.220832 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:37.227827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:37.228302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:37.229041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:37.229474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:37.244318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba HTTP/1.1 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:46:37.245838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.247506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '902f043a-d22e-41d1-b8f7-166e9d9080ba'} Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:46:37.250117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.251643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.253200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:46:37.253200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3c9afd12-3853-42b5-aa07-35c1fd6d06c0 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 404 len: 111 microversion: 2.1 time: 0.030768 Jun 15 00:46:37.253200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 396/751] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:46:37 2022] DELETE /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:37.255637 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:37.256259 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] [instance: 902f043a-d22e-41d1-b8f7-166e9d9080ba] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:37.262204 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:37.262642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:37.263384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:37.264094 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:37.279307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] HTTP exception thrown: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Request method failure captured: Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba HTTP/1.1 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp2bx3ML2LXQ7BtXEIYlnPE9Emw-wdBnzwhVFRwWE6cQk0ayx1u-O9SK3tIe6wFzb2am6a4Un2ZleQehFCWkhaO6wLD91LPpA3IZfriC1TkCTNSyR3oL1zuouAoKK5KRZHornS7MS4MV70Wt6ANnNbiBecGZHydhps2KY_nnxuXS3c Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:46:37.280903 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30f2ff4320764a69bb987d567aed9201", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30f2ff4320764a69bb987d567aed9201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30f2ff4320764a69bb987d567aed9201"}]}] Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 30f2ff4320764a69bb987d567aed9201 Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeTestJSON-251029942 Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: d9a0bbb1f50c42acb50dac254a653da4 Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeTestJSON-251029942-project Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.282692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '902f043a-d22e-41d1-b8f7-166e9d9080ba'} Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:46:37.283588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. Jun 15 00:46:37.285781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:46:37.287052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] Returning 404 to user: Instance 902f043a-d22e-41d1-b8f7-166e9d9080ba could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:46:37.287052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b336812a-8ec0-4052-a566-d932034f4050 tempest-AttachVolumeTestJSON-251029942 tempest-AttachVolumeTestJSON-251029942-project] 10.222.0.17 "GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba" status: 404 len: 111 microversion: 2.1 time: 0.030449 Jun 15 00:46:37.287052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 356/752] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:37 2022] GET /compute/v2.1/servers/902f043a-d22e-41d1-b8f7-166e9d9080ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:38.030580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:38.031066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:38.037604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:38.038134 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:38.038877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:38.039302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:38.369628 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:38.369628 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:38.370481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:38.370481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9d5b16b5-129a-426f-9a44-32438dab563a tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.325445 Jun 15 00:46:38.370481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 397/753] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:38 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:38.983158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-4b3c8b87-ced1-4f7e-91b1-f9daf57ce6fa req-74a1eb03-adc4-4b03-a542-5da6622fd48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "name": "network-vif-plugged", "status": "completed", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:38.993867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4b3c8b87-ced1-4f7e-91b1-f9daf57ce6fa req-74a1eb03-adc4-4b03-a542-5da6622fd48b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:38.994803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4b3c8b87-ced1-4f7e-91b1-f9daf57ce6fa req-74a1eb03-adc4-4b03-a542-5da6622fd48b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:39.009539 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-4b3c8b87-ced1-4f7e-91b1-f9daf57ce6fa req-74a1eb03-adc4-4b03-a542-5da6622fd48b service nova] Creating event network-vif-plugged:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:46:39.015390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-4b3c8b87-ced1-4f7e-91b1-f9daf57ce6fa req-74a1eb03-adc4-4b03-a542-5da6622fd48b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035855 Jun 15 00:46:39.016523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 357/754] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:46:39.386770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:39.387353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:39.395188 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:39.395680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:39.396633 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:39.397064 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:39.675646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:39.683707 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:39.686222 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:39.686931 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ebc94fb6-e839-461e-881c-eb61d04324b6 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.304266 Jun 15 00:46:39.687488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 398/755] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:39 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:40.707964 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:40.708671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:40.715958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:40.716414 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:40.717215 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:40.717832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:40.970196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:40.978777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:40.980439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:40.981747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-47295293-43ba-459a-8eef-0119d31273cc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.280713 Jun 15 00:46:40.982398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 358/756] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:40 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:42.001076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:42.001640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:42.008187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:42.008634 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:42.009394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:42.009827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:42.139515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:42.142956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:42.147844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:42.149372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:42.150526 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1574615a-1ae6-4020-9ad2-15bce7b187d4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1730 microversion: 2.20 time: 0.154047 Jun 15 00:46:42.151080 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 399/757] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:41 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:43.168962 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:43.170329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:43.177658 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:43.178100 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:43.178876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:43.179299 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:43.572702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:43.580850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:43.583052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:43.584413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1d08f74c-868c-4fd3-b908-fbc267a9d274 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1717 microversion: 2.20 time: 0.419307 Jun 15 00:46:43.584965 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 359/758] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:46:43 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1717 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:46:49.287661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cc8bb1d9-be4a-47e3-89ab-a1ec5d6a41e6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: .version_select at 0x7fa81f6aa670>, body: {"keypair": {"name": "tempest-keypair-2068980314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYf4vMx4WvnMtDa9gmz85tIMc7joz+r8kDx/cyzpIWqOOjeAHR73EAw6/XdMQ18TGnkbE4EjXFkR+QHPa87T3ISL1qhkRclE012Htr13QwvIgzrLxyczrdtJ593+MB4Hw=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:49.302922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-cc8bb1d9-be4a-47e3-89ab-a1ec5d6a41e6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:46:49.306820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-cc8bb1d9-be4a-47e3-89ab-a1ec5d6a41e6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:46:49.385383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cc8bb1d9-be4a-47e3-89ab-a1ec5d6a41e6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238811 Jun 15 00:46:49.386099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 400/759] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:46:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:46:51.643028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1932979457", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "745875bd-db66-4942-8b94-73869e4acd94"}], "security_groups": [{"name": "tempest-securitygroup--1374074696"}], "key_name": "tempest-keypair-2068980314", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:51.819332 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] validate_networks() for [('745875bd-db66-4942-8b94-73869e4acd94', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:46:52.360436 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:46:52.360854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:46:52.361321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:46:52.361722 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:46:52.362125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:46:52.380499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:52.381314 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:52.382476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:52.383225 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:52.405816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:46:52.411872 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:46:52.425328 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:46:52.427865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:46:52.546348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3aa96fd8-e7f9-4339-8e6d-c56ab36fb332 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.907941 Jun 15 00:46:52.546991 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 360/760] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:46:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 00:46:52.557144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-78f9160a-3378-466e-86c1-bfcb8f0d926c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:52.562501 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-78f9160a-3378-466e-86c1-bfcb8f0d926c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:52.645010 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-78f9160a-3378-466e-86c1-bfcb8f0d926c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:52.654149 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-78f9160a-3378-466e-86c1-bfcb8f0d926c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1242 microversion: 2.1 time: 0.100757 Jun 15 00:46:52.654840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 401/761] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:52 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:53.670712 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9feb5199-200e-4fd6-aabe-245835bef68a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:53.671348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9feb5199-200e-4fd6-aabe-245835bef68a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:53.725096 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9feb5199-200e-4fd6-aabe-245835bef68a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:53.732188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9feb5199-200e-4fd6-aabe-245835bef68a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1242 microversion: 2.1 time: 0.065109 Jun 15 00:46:53.732912 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 361/762] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:53 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:54.750017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:54.750619 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:54.757167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:54.757604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:54.758346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:54.758771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:54.824195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:54.836299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-63b1a3fc-1f1d-4a91-9453-775a5b090549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1294 microversion: 2.1 time: 0.086076 Jun 15 00:46:54.836299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 402/763] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:54 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:55.850194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:55.850900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:55.853449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:55.858868 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:55.859404 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:55.860288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:55.860796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:56.067933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:56.075374 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c7aee951-0bcb-4d2c-a9bc-fb6ae0ce5835 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.229537 Jun 15 00:46:56.075950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 362/764] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:55 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:56.882565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-e8e8fd4b-7c53-4116-90b4-68ef737a43e4 req-58fc3ef3-b61a-4fb9-8e67-a4209b740b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1", "tag": "3bd0627a-f513-4c34-a89e-9297cd2fe115"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:46:56.897286 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e8e8fd4b-7c53-4116-90b4-68ef737a43e4 req-58fc3ef3-b61a-4fb9-8e67-a4209b740b87 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:56.898171 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-e8e8fd4b-7c53-4116-90b4-68ef737a43e4 req-58fc3ef3-b61a-4fb9-8e67-a4209b740b87 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:56.912173 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-e8e8fd4b-7c53-4116-90b4-68ef737a43e4 req-58fc3ef3-b61a-4fb9-8e67-a4209b740b87 service nova] Creating event network-changed:3bd0627a-f513-4c34-a89e-9297cd2fe115 for instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 on hv-cinder-84517 Jun 15 00:46:56.917187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-e8e8fd4b-7c53-4116-90b4-68ef737a43e4 req-58fc3ef3-b61a-4fb9-8e67-a4209b740b87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180154 Jun 15 00:46:56.918100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 403/765] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:46:57.094950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:57.095491 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:57.102607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:57.103053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:57.103808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:57.104285 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:57.319396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:57.326916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0c59ebbe-f405-4bf2-bba3-6f66fafcb8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.236217 Jun 15 00:46:57.327646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 363/766] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:57 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:58.344331 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:58.345117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:58.351688 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:58.352290 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:58.353221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:58.353664 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:58.563273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:58.571381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d435e558-3a7f-48fc-9515-a624b8313cd8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.231622 Jun 15 00:46:58.571972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 404/767] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:58 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:46:59.589206 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:46:59.590968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:46:59.600518 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:59.601134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:59.601881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:46:59.602344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:46:59.606518 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=61 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:59.775048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:46:59.782462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c8ce8e87-cb74-42fc-8b8c-eff0c505475b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.197667 Jun 15 00:46:59.783028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 364/768] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:46:59 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:00.798821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:00.799427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:00.806254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:00.806693 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:00.807445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:00.807866 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:00.937403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:00.946261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6d8eed99-054b-40a6-80f3-2b06a87be6dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.151529 Jun 15 00:47:00.958990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 405/769] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:00 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:01.177131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-fac38f5d-1fb7-451c-95f0-1aa07f83ac7a req-33b24fd3-9977-4ce2-93b0-b29507ecbf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1", "name": "network-vif-plugged", "status": "completed", "tag": "3bd0627a-f513-4c34-a89e-9297cd2fe115"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:01.187187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-fac38f5d-1fb7-451c-95f0-1aa07f83ac7a req-33b24fd3-9977-4ce2-93b0-b29507ecbf59 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:01.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-fac38f5d-1fb7-451c-95f0-1aa07f83ac7a req-33b24fd3-9977-4ce2-93b0-b29507ecbf59 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:01.201014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-fac38f5d-1fb7-451c-95f0-1aa07f83ac7a req-33b24fd3-9977-4ce2-93b0-b29507ecbf59 service nova] Creating event network-vif-plugged:3bd0627a-f513-4c34-a89e-9297cd2fe115 for instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 on hv-cinder-84517 Jun 15 00:47:01.205965 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-fac38f5d-1fb7-451c-95f0-1aa07f83ac7a req-33b24fd3-9977-4ce2-93b0-b29507ecbf59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Jun 15 00:47:01.206879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 365/770] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:01.965207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:01.965806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:01.972219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:01.972597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:01.973933 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:01.974357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:02.102864 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:02.110439 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-334e49d1-a577-4dff-aa0f-b39a85d91fbb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.149101 Jun 15 00:47:02.111005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 406/771] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:01 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:03.124864 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:03.129081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:03.130286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:03.136362 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:03.137467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:03.137810 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:03.138242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:03.279345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:03.286697 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d785973f-8143-47a8-a22f-d6a06f851b35 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1368 microversion: 2.1 time: 0.163247 Jun 15 00:47:03.287251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 366/772] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:03 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:04.303765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:04.304489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:04.306382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:04.307473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:04.312430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:04.314871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:04.314871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:04.314871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:04.446467 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:04.454537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-67fdf45e-9840-41d0-87a6-cb2136df7b6d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1558 microversion: 2.1 time: 0.154952 Jun 15 00:47:04.455122 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 407/773] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:04 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:04.470745 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:04.471225 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:04.473552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=8 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:04.478526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:04.478965 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:04.479740 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:04.480232 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:04.557679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-139e2830-f896-4605-8780-efd403e76c85 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090833 Jun 15 00:47:04.558278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 367/774] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:47:04 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:05.785995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-ec1321fb-4dd8-4813-897d-454e832f7197 req-a3fc69e1-5d39-475c-9b99-863f0dbbf29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1", "tag": "3bd0627a-f513-4c34-a89e-9297cd2fe115"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:05.795172 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ec1321fb-4dd8-4813-897d-454e832f7197 req-a3fc69e1-5d39-475c-9b99-863f0dbbf29b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:05.795605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-ec1321fb-4dd8-4813-897d-454e832f7197 req-a3fc69e1-5d39-475c-9b99-863f0dbbf29b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:05.807954 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-ec1321fb-4dd8-4813-897d-454e832f7197 req-a3fc69e1-5d39-475c-9b99-863f0dbbf29b service nova] Creating event network-changed:3bd0627a-f513-4c34-a89e-9297cd2fe115 for instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 on hv-cinder-84517 Jun 15 00:47:05.812483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-ec1321fb-4dd8-4813-897d-454e832f7197 req-a3fc69e1-5d39-475c-9b99-863f0dbbf29b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030255 Jun 15 00:47:05.813237 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 408/775] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:16.716079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=11 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:16.716851 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=17 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:16.720891 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:16.721785 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:16.727820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:16.728393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:16.729256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:16.729694 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:16.759514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a6f428a-da74-47a9-b0c1-fdd50e0c813f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044644 Jun 15 00:47:16.763303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 368/776] 10.222.0.17 () {60 vars in 1342 bytes} [Wed Jun 15 00:47:16 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:16.820446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:16.821647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=34 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:16.825700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:16.826274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:16.832442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:16.832884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:16.834214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:16.834639 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:16.859762 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:47:17.148913 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-546b56eb-b6d1-47c3-85c8-87949ccacc40 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 204 len: 0 microversion: 2.20 time: 0.329828 Jun 15 00:47:17.149523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 409/777] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jun 15 00:47:16 2022] DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 00:47:17.157836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:17.158475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:17.165353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:17.165802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:17.166567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:17.167002 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:17.293595 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:17.302650 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:17.304467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:17.305844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ececb150-1b93-4e69-af7d-d20ed449c278 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.151911 Jun 15 00:47:17.306803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 369/778] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:17 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:18.324557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:18.325240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:18.331669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:18.332143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:18.332892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:18.333952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:18.463356 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:18.471129 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:18.472715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:18.474025 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4095fae5-0f03-4822-b923-fbc45c926f2e tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.153981 Jun 15 00:47:18.474587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 410/779] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:18 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:19.492767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:19.493407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:19.499973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:19.500424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:19.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:19.501790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:19.671052 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:19.679520 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:19.681265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:19.682533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6d2fcb4b-051e-4dda-9b0e-d24dfee90dc9 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1723 microversion: 2.20 time: 0.194045 Jun 15 00:47:19.683104 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 370/780] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:19 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:19.970815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4b3a7ec9-3915-4a06-af74-00433cd9401a req-46984b8e-5319-4fc6-aa29-854795839932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a7e579-cb51-4e24-9c35-ddf29ebffe0d", "name": "network-vif-deleted", "tag": "8d0d52f7-9ea5-477f-9531-fa32f51a7c46"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:19.980334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4b3a7ec9-3915-4a06-af74-00433cd9401a req-46984b8e-5319-4fc6-aa29-854795839932 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:19.981455 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4b3a7ec9-3915-4a06-af74-00433cd9401a req-46984b8e-5319-4fc6-aa29-854795839932 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:19.992696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4b3a7ec9-3915-4a06-af74-00433cd9401a req-46984b8e-5319-4fc6-aa29-854795839932 service nova] Creating event network-vif-deleted:8d0d52f7-9ea5-477f-9531-fa32f51a7c46 for instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d on hv-cinder-84517 Jun 15 00:47:19.997806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4b3a7ec9-3915-4a06-af74-00433cd9401a req-46984b8e-5319-4fc6-aa29-854795839932 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Jun 15 00:47:19.998396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 411/781] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:20.702548 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:20.703149 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:20.716921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:20.716921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:20.716921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:20.716921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:20.746335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:20.746778 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:20.747222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'fault' on Instance uuid 69a7e579-cb51-4e24-9c35-ddf29ebffe0d {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:47:20.791632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:20.799788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:20.801314 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:20.802456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0d236945-6863-41ff-9d48-0269fbd7d7b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1370 microversion: 2.20 time: 0.103920 Jun 15 00:47:20.803016 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 371/782] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:20 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:21.821641 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:21.822320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:21.828522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:21.828962 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:21.829698 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:21.830123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:21.861983 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:21.862419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:21.862848 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'fault' on Instance uuid 69a7e579-cb51-4e24-9c35-ddf29ebffe0d {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:47:21.903107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:21.910784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:21.912834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:21.913969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-099d31f5-cd19-4c4c-ab23-2a8643113da4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1370 microversion: 2.20 time: 0.097016 Jun 15 00:47:21.914521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 412/783] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:21 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:22.932314 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:22.932914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:22.939203 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:22.939641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:22.940420 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:22.940843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:22.974246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:22.974246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:22.974246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lazy-loading 'fault' on Instance uuid 69a7e579-cb51-4e24-9c35-ddf29ebffe0d {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:47:23.017376 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:23.025231 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:23.026721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ff9f53decbc44ce9166f6c841e8ea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5075d84d5c6f4ad89f397c8b563e17df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:23.027881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cd80c7f4-9506-40d9-b5a3-b880b96d6f68 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 200 len: 1370 microversion: 2.20 time: 0.099484 Jun 15 00:47:23.028457 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 372/784] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:22 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 00:47:24.046506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:24.047195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:24.053675 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:24.054186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:24.054977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:24.055417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:24.069287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d HTTP/1.1 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:47:24.070953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:24.072725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '69a7e579-cb51-4e24-9c35-ddf29ebffe0d'} Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:24.073677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:24.075184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:24.076929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:24.076929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0182311f-b362-4964-9f94-2e9058b50d17 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 404 len: 111 microversion: 2.20 time: 0.029817 Jun 15 00:47:24.076929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 413/785] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:24 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:47:24.081422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-78efa097-c5fa-4b78-9f2e-f140321ce60d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '.version_select at 0x7fa81f6de670>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:24.207127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-78efa097-c5fa-4b78-9f2e-f140321ce60d tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-944906613" status: 204 len: 0 microversion: 2.20 time: 0.129402 Jun 15 00:47:24.207704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 373/786] 10.222.0.17 () {60 vars in 1258 bytes} [Wed Jun 15 00:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-944906613 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 00:47:26.175016 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:26.175517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:26.182368 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:26.182813 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:26.183557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:26.184006 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:26.197732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d HTTP/1.1 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:47:26.199228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.200842 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '69a7e579-cb51-4e24-9c35-ddf29ebffe0d'} Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:26.201636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.202793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.204087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:26.204087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2a6ffbdb-81d9-4168-a0d2-715ba615d42f tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 404 len: 111 microversion: 2.20 time: 0.029577 Jun 15 00:47:26.204087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 414/787] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jun 15 00:47:26 2022] DELETE /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:47:26.208940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:26.209566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 69a7e579-cb51-4e24-9c35-ddf29ebffe0d] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:26.216774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:26.217217 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:26.217958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:26.218385 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:26.231369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d HTTP/1.1 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:47:26.232989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.234541 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '69a7e579-cb51-4e24-9c35-ddf29ebffe0d'} Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:26.235394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. Jun 15 00:47:26.236875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:26.238049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 69a7e579-cb51-4e24-9c35-ddf29ebffe0d could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:26.238049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d969b80b-a67c-429f-8bd6-762035d838fc tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d" status: 404 len: 111 microversion: 2.20 time: 0.029319 Jun 15 00:47:26.238049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 374/788] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:26 2022] GET /compute/v2.1/servers/69a7e579-cb51-4e24-9c35-ddf29ebffe0d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:47:27.469664 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:27.470147 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:27.476601 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:27.477052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:27.477836 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:27.478261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:27.491985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 HTTP/1.1 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:47:27.494918 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.499061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '4384856b-b368-4857-a5d7-431d19403918'} Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:27.499773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.501200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.502595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:27.502595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f0d90b67-87a3-4070-b0d7-688a3235a8b4 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 404 len: 111 microversion: 2.20 time: 0.029130 Jun 15 00:47:27.502595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 415/789] 10.222.0.17 () {60 vars in 1279 bytes} [Wed Jun 15 00:47:27 2022] DELETE /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:47:27.503192 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:27.503789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] [instance: 4384856b-b368-4857-a5d7-431d19403918] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:27.511043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:27.511482 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:27.512301 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:27.512730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:27.525805 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] HTTP exception thrown: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Request method failure captured: Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 HTTP/1.1 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSp4aoABJEba_t_-lZQy99DqqLmg-c2v8R8fnAsL9faN9KlfmRGNkmxfE-vlQxvG712bTJkJIsAmLqTsClY22PwUDlzSfO6JR7cB4pgMu1D1HbqA9nOrf9gBOEH9lLeHkc0anD9SzZxt6m8QcHBcfsiMSS5MeHxBtsE0cnF4OTp2U30 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:47:27.527281 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5075d84d5c6f4ad89f397c8b563e17df", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5075d84d5c6f4ad89f397c8b563e17df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5075d84d5c6f4ad89f397c8b563e17df"}]}] Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 5075d84d5c6f4ad89f397c8b563e17df Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1267292417 Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 2ff9f53decbc44ce9166f6c841e8ea02 Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1267292417-project Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '4384856b-b368-4857-a5d7-431d19403918'} Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:27.529782 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. Jun 15 00:47:27.531160 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:27.532513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] Returning 404 to user: Instance 4384856b-b368-4857-a5d7-431d19403918 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:27.532513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7f392cdc-a8f3-44b7-b0e5-0eb8dd071f70 tempest-AttachVolumeShelveTestJSON-1267292417 tempest-AttachVolumeShelveTestJSON-1267292417-project] 10.222.0.17 "GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918" status: 404 len: 111 microversion: 2.20 time: 0.029328 Jun 15 00:47:27.532513 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 375/790] 10.222.0.17 () {60 vars in 1276 bytes} [Wed Jun 15 00:47:27 2022] GET /compute/v2.1/servers/4384856b-b368-4857-a5d7-431d19403918 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:47:32.901757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ad54fef7-3e3b-431f-b8d1-865ecd7c62b4 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Action: 'create', calling method: .version_select at 0x7fa81f6a1d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1489888096"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:32.984614 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:32.985122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:32.995294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:32.995424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:32.996396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:32.996842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:33.037810 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:47:33.423060 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ab21abb8-e010-40b1-ba24-8551654e6616 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 204 len: 0 microversion: 2.1 time: 0.441972 Jun 15 00:47:33.423644 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 376/791] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:47:32 2022] DELETE /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:47:33.434680 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-4e9ff2d7-9f6a-48e7-9ad8-173cc9649015 req-be529df3-4155-47d9-8c71-64b65cd7d079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:33.437669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4e9ff2d7-9f6a-48e7-9ad8-173cc9649015 req-be529df3-4155-47d9-8c71-64b65cd7d079 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:33.438173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-4e9ff2d7-9f6a-48e7-9ad8-173cc9649015 req-be529df3-4155-47d9-8c71-64b65cd7d079 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:33.449918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-4e9ff2d7-9f6a-48e7-9ad8-173cc9649015 req-be529df3-4155-47d9-8c71-64b65cd7d079 service nova] Creating event network-changed:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:47:33.454769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-4e9ff2d7-9f6a-48e7-9ad8-173cc9649015 req-be529df3-4155-47d9-8c71-64b65cd7d079 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029604 Jun 15 00:47:33.461172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 377/792] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:33.461172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:33.461172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:33.467251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:33.467725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:33.468498 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:33.468933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:33.625696 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:33.645009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-94963a39-4913-44ed-80bd-3f3abc06d3d9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.179033 Jun 15 00:47:33.645009 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 378/793] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:33 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:33.788248 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ad54fef7-3e3b-431f-b8d1-865ecd7c62b4 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.003206 Jun 15 00:47:33.788360 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 416/794] 10.222.0.17 () {60 vars in 1154 bytes} [Wed Jun 15 00:47:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1005 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 00:47:33.799651 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-71b4c428-f463-4c16-be48-f3803a771fa2 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa824079dc0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:33.862014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-71b4c428-f463-4c16-be48-f3803a771fa2 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 200 len: 345 microversion: 2.1 time: 0.066545 Jun 15 00:47:33.862816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 379/795] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:47:33 2022] GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:47:34.661928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:34.662535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:34.669286 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:34.669763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:34.670517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:34.670944 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:34.836945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:34.844565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e0c6af2f-da08-4766-bf66-49150403a64c tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1569 microversion: 2.1 time: 0.186857 Jun 15 00:47:34.845254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 417/796] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:34 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:34.874975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a4783942-af8f-4b6b-8300-43ad88f6d62e tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6d44c0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:34.920166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a4783942-af8f-4b6b-8300-43ad88f6d62e tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 200 len: 346 microversion: 2.1 time: 0.049326 Jun 15 00:47:34.920784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 380/797] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:47:34 2022] GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:34.939074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f20445df-4e15-4f03-907b-a99e0775333d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Action: 'create', calling method: .version_select at 0x7fa81f6aac10>, body: {"snapshot": {"volume_id": "0265a873-5f3f-4e0d-b127-f71126386e30", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1664828543"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:35.380454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f20445df-4e15-4f03-907b-a99e0775333d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.445236 Jun 15 00:47:35.381490 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 418/798] 10.222.0.17 () {60 vars in 1161 bytes} [Wed Jun 15 00:47:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:35.398069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c5a04571-42d6-4739-8efc-403022f7e176 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f7f01f0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:35.435575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c5a04571-42d6-4739-8efc-403022f7e176 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.045419 Jun 15 00:47:35.435575 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 381/799] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:35 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:35.443880 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7ad7d040-db96-43ae-a7d0-786d6c6efb6d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6a15e0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:35.483224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7ad7d040-db96-43ae-a7d0-786d6c6efb6d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043233 Jun 15 00:47:35.484395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 419/800] 10.222.0.17 () {58 vars in 1139 bytes} [Wed Jun 15 00:47:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:35.494821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4a3593a5-93a2-48a7-8c13-919118601de0 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6e4b80>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:35.528686 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4a3593a5-93a2-48a7-8c13-919118601de0 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.038170 Jun 15 00:47:35.529527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 382/801] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:35 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:35.862772 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:35.863561 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:35.871123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:35.871658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:35.872680 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:35.873170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:35.957009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:35.958797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-35940c99-142e-460e-b722-d26ee34855ca req-b6512b8d-597e-42d0-81cf-f2f29556a38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697d7d3-580e-4230-9460-8e6718bab104", "name": "network-vif-deleted", "tag": "4c6aff95-ee73-4591-8e3e-7acfc2ef8324"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:35.970249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-35940c99-142e-460e-b722-d26ee34855ca req-b6512b8d-597e-42d0-81cf-f2f29556a38c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:35.972193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-35940c99-142e-460e-b722-d26ee34855ca req-b6512b8d-597e-42d0-81cf-f2f29556a38c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:35.972336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-82d4edd3-e804-4849-9147-bdf8101509c5 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1501 microversion: 2.1 time: 0.113714 Jun 15 00:47:35.972336 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 420/802] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:35 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1501 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:35.983249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-35940c99-142e-460e-b722-d26ee34855ca req-b6512b8d-597e-42d0-81cf-f2f29556a38c service nova] Creating event network-vif-deleted:4c6aff95-ee73-4591-8e3e-7acfc2ef8324 for instance c697d7d3-580e-4230-9460-8e6718bab104 on hv-cinder-84517 Jun 15 00:47:35.988274 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-35940c99-142e-460e-b722-d26ee34855ca req-b6512b8d-597e-42d0-81cf-f2f29556a38c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Jun 15 00:47:35.989236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 383/803] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:47:36.546650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ab3fc035-b0a6-49c2-bd84-d777ad242cee tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa824106ee0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:36.577204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ab3fc035-b0a6-49c2-bd84-d777ad242cee tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.040378 Jun 15 00:47:36.577767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 421/804] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:36 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:36.988310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:36.988998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:36.996323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:36.996826 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:36.997566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:36.997991 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:37.065300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:37.072835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6930251c-30f4-4be3-bdf8-b3cb81eff546 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1218 microversion: 2.1 time: 0.088805 Jun 15 00:47:37.073375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 384/805] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:36 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:37.589903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5514d023-ce92-4dea-b481-08f0fb01f7a5 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f7ba040>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:37.618381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5514d023-ce92-4dea-b481-08f0fb01f7a5 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.032897 Jun 15 00:47:37.618945 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 422/806] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:37 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:38.095852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:38.096480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:38.102949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:38.103391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:38.104168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:38.104604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:38.167080 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:38.174644 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bb2c01ff-7b5d-4d42-a50c-7b15a97d99b9 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1218 microversion: 2.1 time: 0.082542 Jun 15 00:47:38.175196 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 385/807] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:38 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:38.630830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-05b528f4-e1f2-4878-9610-bd217b03c9be tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6a1e50>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:38.663429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-05b528f4-e1f2-4878-9610-bd217b03c9be tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.036327 Jun 15 00:47:38.664285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 423/808] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:38 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:39.191958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:39.192573 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:39.199456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:39.199892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:39.200658 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:39.201082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:39.260007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:39.267558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8c2c079d-009c-4862-b892-f6740eb458b3 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1218 microversion: 2.1 time: 0.079481 Jun 15 00:47:39.268269 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 386/809] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:39 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:39.675351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-81660d8a-74de-4b12-a550-45e85c00a0be tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f687700>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:39.705541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-81660d8a-74de-4b12-a550-45e85c00a0be tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 288 microversion: 2.1 time: 0.034520 Jun 15 00:47:39.706215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 424/810] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:39 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:39.717695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2587049a-6f52-4731-bb7e-84782665af6c tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa8240799d0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:39.863266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2587049a-6f52-4731-bb7e-84782665af6c tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 202 len: 0 microversion: 2.1 time: 0.150820 Jun 15 00:47:39.863820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 387/811] 10.222.0.17 () {58 vars in 1253 bytes} [Wed Jun 15 00:47:39 2022] DELETE /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:47:39.872802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2f5e28f0-03ec-4c8b-9497-cda06ada1bc1 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6bde50>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:39.901739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2f5e28f0-03ec-4c8b-9497-cda06ada1bc1 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 200 len: 287 microversion: 2.1 time: 0.032860 Jun 15 00:47:39.902302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 425/812] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:39 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:40.284615 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:40.290075 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:40.291752 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:40.292244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:40.292985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:40.293409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:40.323170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:40.323608 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:40.324077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lazy-loading 'fault' on Instance uuid c697d7d3-580e-4230-9460-8e6718bab104 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:47:40.364392 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7488c1659ed64e9bb4c28a7284578d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4020df94dce44ce6bfe88478e6efa55f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:40.371732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8e87888c-9234-4c9c-bbba-d1c563eee9ef tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 200 len: 1223 microversion: 2.1 time: 0.091425 Jun 15 00:47:40.372381 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 388/813] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:40 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:40.913109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-842ed4a4-7414-42cc-a066-76c437f88e99 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6a1160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:40.937459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-842ed4a4-7414-42cc-a066-76c437f88e99 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] HTTP exception thrown: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-842ed4a4-7414-42cc-a066-76c437f88e99 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Request method failure captured: Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 HTTP/1.1 Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSwkdq_4JrB5h0z6G5wNhUBzSEWBngpv69cYfhH7_BkFLcstmTAKCODvGWd740-v-ELjgkUXADgPnNsmDC2_Gg16JkXhcXhJF_bKi9Dmg5sl8t1cEuys_yu0rMPTLHYaELTtAowWXR5Wy0HypfbKcqScJieopVX6K8JfB1E2_Ar5P9Y Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:47:40.939685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfd569e249414edb910f298f70b9218e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfd569e249414edb910f298f70b9218e"}]}] Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 46f837bc019e4e1a86f63d20a9790c2b Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'aa4c69fe-d055-49a0-80c2-ab7302bbaf24'} Jun 15 00:47:40.941327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. (HTTP 404) (Request-ID: req-0e56c457-04b9-417c-95ff-95bc75ff3b4e) Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.942372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:40.943715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 00:47:40.945340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-842ed4a4-7414-42cc-a066-76c437f88e99 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Returning 404 to user: Snapshot aa4c69fe-d055-49a0-80c2-ab7302bbaf24 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:40.947433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-842ed4a4-7414-42cc-a066-76c437f88e99 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24" status: 404 len: 111 microversion: 2.1 time: 0.032335 Jun 15 00:47:40.948429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 426/814] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:40 2022] GET /compute/v2.1/os-snapshots/aa4c69fe-d055-49a0-80c2-ab7302bbaf24 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:47:40.950164 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-081619d9-1319-4b51-800d-a1003054319d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6f15e0>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:41.137718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-081619d9-1319-4b51-800d-a1003054319d tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 202 len: 0 microversion: 2.1 time: 0.191144 Jun 15 00:47:41.143678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 389/815] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:47:40 2022] DELETE /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:47:41.146838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fed8b98c-1b3e-43dc-9523-e6a77863d9ff tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa8240289d0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:41.198800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fed8b98c-1b3e-43dc-9523-e6a77863d9ff tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 200 len: 345 microversion: 2.1 time: 0.049943 Jun 15 00:47:41.198800 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 427/816] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:47:41 2022] GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:41.389453 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:41.390321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] [instance: c697d7d3-580e-4230-9460-8e6718bab104] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:41.396360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:41.396801 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:41.397589 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:41.398023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:41.411229 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] HTTP exception thrown: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Request method failure captured: Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 HTTP/1.1 Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSrVbsOH_7XIba6YTirceUwwlinXCJHI6Q56a5JeAHE5vbwNoMRHHPvZaxKHjffWvs9iD-m-Fw2Y14jxtevcks1nT68sdGoSoqosRot0zD02mGnYv9wYx6iTGaL0_cGqo8kMZpjgu1oKHwDPVgonz-hw87wYjpfJ_jhPC828WaXdq6s Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 4020df94dce44ce6bfe88478e6efa55f Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestShelveInstance-291042523 Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:47:41.412850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4020df94dce44ce6bfe88478e6efa55f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4020df94dce44ce6bfe88478e6efa55f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4020df94dce44ce6bfe88478e6efa55f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4020df94dce44ce6bfe88478e6efa55f"}]}] Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestShelveInstance-291042523 Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 4020df94dce44ce6bfe88478e6efa55f Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestShelveInstance-291042523 Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-TestShelveInstance-291042523-project Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 7488c1659ed64e9bb4c28a7284578d29 Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestShelveInstance-291042523-project Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. Jun 15 00:47:41.414811 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': 'c697d7d3-580e-4230-9460-8e6718bab104'} Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:41.416350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. Jun 15 00:47:41.418883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:41.421507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Returning 404 to user: Instance c697d7d3-580e-4230-9460-8e6718bab104 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:41.421507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-56ed996f-58c5-43df-9b71-50e4b022f857 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104" status: 404 len: 111 microversion: 2.1 time: 0.029123 Jun 15 00:47:41.421507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 390/817] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:41 2022] GET /compute/v2.1/servers/c697d7d3-580e-4230-9460-8e6718bab104 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:47:41.640416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-644930fc-aa3b-4d81-8733-578f450d3733 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] Calling method '.version_select at 0x7fa81f6aa160>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:41.721468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-644930fc-aa3b-4d81-8733-578f450d3733 tempest-TestShelveInstance-291042523 tempest-TestShelveInstance-291042523-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-567236908" status: 202 len: 0 microversion: 2.1 time: 0.085403 Jun 15 00:47:41.722129 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 428/818] 10.222.0.17 () {58 vars in 1250 bytes} [Wed Jun 15 00:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-567236908 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:47:42.205580 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c7d64cab-a65e-4492-b692-ec66357dd567 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f7f0790>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:42.236381 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-c7d64cab-a65e-4492-b692-ec66357dd567 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] HTTP exception thrown: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c7d64cab-a65e-4492-b692-ec66357dd567 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Request method failure captured: Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 HTTP/1.1 Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSwkdq_4JrB5h0z6G5wNhUBzSEWBngpv69cYfhH7_BkFLcstmTAKCODvGWd740-v-ELjgkUXADgPnNsmDC2_Gg16JkXhcXhJF_bKi9Dmg5sl8t1cEuys_yu0rMPTLHYaELTtAowWXR5Wy0HypfbKcqScJieopVX6K8JfB1E2_Ar5P9Y Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:47:42.237446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfd569e249414edb910f298f70b9218e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfd569e249414edb910f298f70b9218e"}]}] Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 46f837bc019e4e1a86f63d20a9790c2b Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '0265a873-5f3f-4e0d-b127-f71126386e30'} Jun 15 00:47:42.238679 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. (HTTP 404) (Request-ID: req-0dee286d-54e2-4c3c-bb6e-fc99e6a91856) Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.239571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:42.240672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 00:47:42.241759 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c7d64cab-a65e-4492-b692-ec66357dd567 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Returning 404 to user: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c7d64cab-a65e-4492-b692-ec66357dd567 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 404 len: 109 microversion: 2.1 time: 0.037251 Jun 15 00:47:42.242876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 391/819] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:47:42 2022] GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:47:42.254148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-70235f41-3fcc-4832-8f8f-61d87c344338 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f6aae50>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:42.283099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-70235f41-3fcc-4832-8f8f-61d87c344338 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] HTTP exception thrown: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-70235f41-3fcc-4832-8f8f-61d87c344338 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Request method failure captured: Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 HTTP/1.1 Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSwkdq_4JrB5h0z6G5wNhUBzSEWBngpv69cYfhH7_BkFLcstmTAKCODvGWd740-v-ELjgkUXADgPnNsmDC2_Gg16JkXhcXhJF_bKi9Dmg5sl8t1cEuys_yu0rMPTLHYaELTtAowWXR5Wy0HypfbKcqScJieopVX6K8JfB1E2_Ar5P9Y Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:47:42.285163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfd569e249414edb910f298f70b9218e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfd569e249414edb910f298f70b9218e"}]}] Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 46f837bc019e4e1a86f63d20a9790c2b Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '0265a873-5f3f-4e0d-b127-f71126386e30'} Jun 15 00:47:42.286474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. (HTTP 404) (Request-ID: req-e3c5fec0-6e6e-4a67-a581-09454a49f518) Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.287584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 00:47:42.289433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 00:47:42.290671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-70235f41-3fcc-4832-8f8f-61d87c344338 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Returning 404 to user: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-70235f41-3fcc-4832-8f8f-61d87c344338 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 404 len: 109 microversion: 2.1 time: 0.037031 Jun 15 00:47:42.291889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 429/820] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:47:42 2022] DELETE /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:47:42.296310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-689c73e1-9a16-451f-b52a-616eab538b26 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Calling method '.version_select at 0x7fa81f778700>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:42.326222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-689c73e1-9a16-451f-b52a-616eab538b26 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] HTTP exception thrown: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-689c73e1-9a16-451f-b52a-616eab538b26 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Request method failure captured: Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 HTTP/1.1 Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSwkdq_4JrB5h0z6G5wNhUBzSEWBngpv69cYfhH7_BkFLcstmTAKCODvGWd740-v-ELjgkUXADgPnNsmDC2_Gg16JkXhcXhJF_bKi9Dmg5sl8t1cEuys_yu0rMPTLHYaELTtAowWXR5Wy0HypfbKcqScJieopVX6K8JfB1E2_Ar5P9Y Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:47:42.330076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfd569e249414edb910f298f70b9218e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfd569e249414edb910f298f70b9218e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfd569e249414edb910f298f70b9218e"}]}] Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: cfd569e249414edb910f298f70b9218e Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1212644363 Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 46f837bc019e4e1a86f63d20a9790c2b Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1212644363-project Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '0265a873-5f3f-4e0d-b127-f71126386e30'} Jun 15 00:47:42.331480 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. (HTTP 404) (Request-ID: req-e56b0bd7-fd27-4e05-a228-3f65b3c2ec3c) Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.332839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 00:47:42.334688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 00:47:42.336716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-689c73e1-9a16-451f-b52a-616eab538b26 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] Returning 404 to user: Volume 0265a873-5f3f-4e0d-b127-f71126386e30 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-689c73e1-9a16-451f-b52a-616eab538b26 tempest-VolumesSnapshotsTestJSON-1212644363 tempest-VolumesSnapshotsTestJSON-1212644363-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30" status: 404 len: 109 microversion: 2.1 time: 0.038227 Jun 15 00:47:42.338135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 392/821] 10.222.0.17 () {58 vars in 1244 bytes} [Wed Jun 15 00:47:42 2022] GET /compute/v2.1/os-volumes/0265a873-5f3f-4e0d-b127-f71126386e30 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:47:48.151288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:48.155810 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-501788095", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "networks": [{"uuid": "2d047fe3-bb0d-4596-916d-c08afb9f5946"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:48.171996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:48.219716 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] validate_networks() for [('2d047fe3-bb0d-4596-916d-c08afb9f5946', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:47:49.010499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:47:49.010907 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:47:49.011636 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:47:49.012085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:47:49.012488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:47:49.022742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:49.024527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:49.027326 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:49.027326 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:49.044242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Getting quotas for project c0de2588b13e487a91aaf1ad7ea7bd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:47:49.050118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Getting quotas for user 513b7a90f9fe4d91aea642eae12b3753 and project c0de2588b13e487a91aaf1ad7ea7bd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:47:49.066206 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:47:49.069531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:47:49.149423 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:49.159957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:49.159957 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:49.162276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:49.162736 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:49.163533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:49.166059 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:49.178191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:49.225899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cc3d9dfa-72e5-4afb-8816-eafaae31d62a tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071702 Jun 15 00:47:49.226955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 430/822] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:47:49.236486 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f256c3e3-6b4b-43cf-8475-2fb491a7e987 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:49.237094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f256c3e3-6b4b-43cf-8475-2fb491a7e987 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:49.255476 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-977020ec-7b66-48bb-8f67-8bf72a522b3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/ips" status: 200 len: 149 microversion: 2.1 time: 0.111731 Jun 15 00:47:49.263199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 393/823] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:47:49 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/ips => generated 149 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:47:49.336679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f256c3e3-6b4b-43cf-8475-2fb491a7e987 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:49.346622 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f256c3e3-6b4b-43cf-8475-2fb491a7e987 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1218 microversion: 2.1 time: 0.113872 Jun 15 00:47:49.350616 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 431/824] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:49 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:50.364005 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e04e4fc1-3723-4cb3-bf8d-516478165916 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:50.364615 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e04e4fc1-3723-4cb3-bf8d-516478165916 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:50.434581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e04e4fc1-3723-4cb3-bf8d-516478165916 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:50.441115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e04e4fc1-3723-4cb3-bf8d-516478165916 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1218 microversion: 2.1 time: 0.081733 Jun 15 00:47:50.441678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 394/825] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:50 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:51.147777 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cde3b04-687d-4616-8d3f-7c1cce290c74"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:51.149502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:51.155970 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:51.156419 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:51.157171 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:51.157602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:51.458494 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:51.460007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:51.472285 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:51.473057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:51.474433 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:51.474865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:51.549248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:51.560255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7119490f-afa6-4eee-9de2-2522de5da21d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1270 microversion: 2.1 time: 0.105704 Jun 15 00:47:51.561232 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 395/826] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:51 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:47:52.216221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d1f013d7-1d21-4932-b1b0-ebb30a3a7d18 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.072400 Jun 15 00:47:52.221742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 432/827] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:47:51 2022] POST /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments => generated 194 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:52.577839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:52.579702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:52.585590 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:52.586076 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:52.586846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:52.587272 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:52.801028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:52.809405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0bf0e56a-3dbc-4cad-8c4b-7daf607b04ba tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.235464 Jun 15 00:47:52.818795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 396/828] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:52 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:53.410933 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5238c9b0-107d-4387-8491-7ae4d8a3fcb7 req-d2f7c079-8ce5-4ed5-ab03-19b3d8cd60ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd3facf-4836-4eb2-be5f-10802ffd6061", "tag": "48bc05bd-5121-48e1-a2a1-0190dc0bec97"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:53.422678 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5238c9b0-107d-4387-8491-7ae4d8a3fcb7 req-d2f7c079-8ce5-4ed5-ab03-19b3d8cd60ee service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:53.423629 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5238c9b0-107d-4387-8491-7ae4d8a3fcb7 req-d2f7c079-8ce5-4ed5-ab03-19b3d8cd60ee service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:53.435785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5238c9b0-107d-4387-8491-7ae4d8a3fcb7 req-d2f7c079-8ce5-4ed5-ab03-19b3d8cd60ee service nova] Creating event network-changed:48bc05bd-5121-48e1-a2a1-0190dc0bec97 for instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 on hv-cinder-84517 Jun 15 00:47:53.440551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5238c9b0-107d-4387-8491-7ae4d8a3fcb7 req-d2f7c079-8ce5-4ed5-ab03-19b3d8cd60ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034104 Jun 15 00:47:53.441128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 433/829] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:53.827427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:53.827784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:53.834629 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:53.835092 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:53.836521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:53.836862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:54.047567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:54.056351 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f767312a-6cce-4c3d-9f1f-5ea794fb2c38 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.233093 Jun 15 00:47:54.057130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 397/830] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:53 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:55.074804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:55.075524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:55.081721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:55.082163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:55.082909 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:55.083385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:55.209958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:55.217906 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0f954426-b173-41fd-b6f5-8d02cd9cd0d5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.148287 Jun 15 00:47:55.220967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 434/831] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:55 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:56.234800 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:56.235399 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:56.241863 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:56.242300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:56.243043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:56.243550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:56.377937 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:56.385491 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-43790fee-5c9b-4184-b1a0-38ed60a75b8f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.154691 Jun 15 00:47:56.386140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 398/832] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:56 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:57.402351 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:57.403524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:57.409970 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:57.410404 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:57.411152 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:57.411575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:57.543742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:57.551341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-acf47616-5838-4d26-b06e-1a4aa2069e1d tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.152863 Jun 15 00:47:57.551958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 435/833] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:57 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:58.255321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-c549f8a6-c11c-4974-92e4-05776e01c3d5 req-c7a74438-0990-435e-9c45-02f8b6c4a9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd3facf-4836-4eb2-be5f-10802ffd6061", "name": "network-vif-plugged", "status": "completed", "tag": "48bc05bd-5121-48e1-a2a1-0190dc0bec97"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:47:58.264335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c549f8a6-c11c-4974-92e4-05776e01c3d5 req-c7a74438-0990-435e-9c45-02f8b6c4a9cb service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:58.264777 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c549f8a6-c11c-4974-92e4-05776e01c3d5 req-c7a74438-0990-435e-9c45-02f8b6c4a9cb service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:58.276334 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-c549f8a6-c11c-4974-92e4-05776e01c3d5 req-c7a74438-0990-435e-9c45-02f8b6c4a9cb service nova] Creating event network-vif-plugged:48bc05bd-5121-48e1-a2a1-0190dc0bec97 for instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 on hv-cinder-84517 Jun 15 00:47:58.281211 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-c549f8a6-c11c-4974-92e4-05776e01c3d5 req-c7a74438-0990-435e-9c45-02f8b6c4a9cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 Jun 15 00:47:58.281770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 399/834] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:47:58.568501 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:58.569723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:58.576987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:58.577432 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:58.579123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:58.579123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:58.708110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:58.715546 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aebf1faf-f8c7-405b-8363-2d5031ce14fc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.150861 Jun 15 00:47:58.717143 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 436/835] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:58 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:47:59.735071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:47:59.735757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:47:59.742242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:59.742714 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:59.743456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:47:59.743881 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:47:59.876216 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:47:59.885001 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7dc41c6d-b4fa-4832-8683-755d3f17b746 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1318 microversion: 2.1 time: 0.154639 Jun 15 00:47:59.885569 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 400/836] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:47:59 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:00.784050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b84f4cde-4c6e-433a-bb64-0090d342629e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: .version_select at 0x7fa81f667a60>, body: {"keypair": {"name": "tempest-keypair-848002657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZDY+tc+sGulqxp317jCdRw/qz7Ms0S/KUMH7QC3MlfUU5FkaZUHaA+yrp8nESOJmjtlyJRZINF+z4o7dv4EEwMFlxFwIH+35Fq56tebrITc24RmatLVOmqSEvOFLF0Iw=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:00.787976 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:00.788731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=8 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:00.802588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b84f4cde-4c6e-433a-bb64-0090d342629e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:48:00.806502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-b84f4cde-4c6e-433a-bb64-0090d342629e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:48:00.899223 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b84f4cde-4c6e-433a-bb64-0090d342629e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119061 Jun 15 00:48:00.899820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 437/837] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:48:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:48:00.903154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:00.903765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:00.905846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:00.911170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:00.911617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:00.912406 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:00.912842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:01.041358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:01.048728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-eb48f6fd-0b7b-4b57-90d7-6bcb8b97bbc7 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1506 microversion: 2.1 time: 0.149672 Jun 15 00:48:01.049290 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 401/838] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:00 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:48:03.034418 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-84957911", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "745875bd-db66-4942-8b94-73869e4acd94"}], "security_groups": [{"name": "tempest-securitygroup--1229681074"}], "key_name": "tempest-keypair-848002657", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:03.141347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] validate_networks() for [('745875bd-db66-4942-8b94-73869e4acd94', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:48:03.528219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:48:03.528702 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:48:03.529218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:48:03.529749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:48:03.530158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:48:03.539032 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:03.539503 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:03.542408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:03.542408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:03.557408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:48:03.561719 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:48:03.574929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:48:03.577221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:48:03.716113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4d592ccc-8cc4-4622-bd27-bb442b9d6760 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686308 Jun 15 00:48:03.722975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 438/839] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:48:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:48:03.728237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0e6699d9-75aa-439a-9106-3f91b0504787 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:03.728997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0e6699d9-75aa-439a-9106-3f91b0504787 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:03.817263 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0e6699d9-75aa-439a-9106-3f91b0504787 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:03.832061 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0e6699d9-75aa-439a-9106-3f91b0504787 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1239 microversion: 2.1 time: 0.107347 Jun 15 00:48:03.832790 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 402/840] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:03 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:04.850685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:04.851254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:04.860239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:04.860684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:04.861433 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:04.861862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:04.927116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:04.935981 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b3d3b42a-95f0-476d-85d7-2bbf4fa82c90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1243 microversion: 2.1 time: 0.088514 Jun 15 00:48:04.936460 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 439/841] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:04 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:05.962247 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:05.962247 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:05.966022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:05.966540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:05.967299 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:05.967978 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:06.057947 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:06.066014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7ba31868-7d2f-49af-9b19-775677357ae8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1299 microversion: 2.1 time: 0.111402 Jun 15 00:48:06.075808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 403/842] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:05 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:07.095387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:07.096173 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:07.102696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:07.103422 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:07.104255 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:07.104748 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:07.371124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:07.378770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a7b4385b-d74f-42c9-8611-6f9dd9864d88 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.300093 Jun 15 00:48:07.379410 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 440/843] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:07 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:07.828853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-145f614a-5bb7-4fc9-ac23-4948184454ec req-aca2859c-e73b-4c9f-8cd4-c16171514e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9415985-9e06-4135-93bc-100cdb69e55c", "tag": "5b9e748a-ac62-44d0-8a29-73e5aa5ee509"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:07.839688 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-145f614a-5bb7-4fc9-ac23-4948184454ec req-aca2859c-e73b-4c9f-8cd4-c16171514e4a service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:07.840462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-145f614a-5bb7-4fc9-ac23-4948184454ec req-aca2859c-e73b-4c9f-8cd4-c16171514e4a service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:07.853201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-145f614a-5bb7-4fc9-ac23-4948184454ec req-aca2859c-e73b-4c9f-8cd4-c16171514e4a service nova] Creating event network-changed:5b9e748a-ac62-44d0-8a29-73e5aa5ee509 for instance c9415985-9e06-4135-93bc-100cdb69e55c on hv-cinder-84517 Jun 15 00:48:07.858566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-145f614a-5bb7-4fc9-ac23-4948184454ec req-aca2859c-e73b-4c9f-8cd4-c16171514e4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037180 Jun 15 00:48:07.859177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 404/844] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:48:08.401085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:08.401805 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:08.409928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:08.411861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:08.412727 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:08.413324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:08.579781 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:08.587785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0de8e15e-f116-4892-855d-1661f1cb60a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.194009 Jun 15 00:48:08.588374 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 441/845] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:08 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:09.606131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:09.606821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:09.613120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:09.613564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:09.614388 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:09.614816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:09.747787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:09.756004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3f9aec90-68c0-4393-83e9-ad453822a191 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.154396 Jun 15 00:48:09.756812 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 405/846] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:09 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:10.773483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:10.774079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:10.780587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:10.781077 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:10.781913 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:10.782375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:10.927808 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:10.935179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-65d870c3-3945-4771-b8e2-2dc3b13262c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.165531 Jun 15 00:48:10.935740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 442/847] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:10 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:11.951955 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:11.952558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:11.958948 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:11.959386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:11.960153 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:11.960635 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:12.099709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:12.111285 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2be07fb6-dd55-4aa8-ad90-f3c373051387 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.163084 Jun 15 00:48:12.114055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 406/848] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:11 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:48:13.130530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:13.131128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:13.138103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:13.138539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:13.139280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:13.139702 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:13.269723 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:13.277344 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bdab3aa2-7d9d-41fa-abce-f607115f7f0c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.150472 Jun 15 00:48:13.277890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 443/849] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:13 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:14.293220 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:14.293830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:14.297364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:14.300836 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:14.301419 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:14.302176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:14.302607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:14.318130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-26a30a3e-8ac6-4980-8e6f-bbdbd3cc9264 req-5e2b9350-362a-484f-a558-af697a463fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9415985-9e06-4135-93bc-100cdb69e55c", "name": "network-vif-plugged", "status": "completed", "tag": "5b9e748a-ac62-44d0-8a29-73e5aa5ee509"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:14.322635 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:14.323580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=10 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:14.329632 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-26a30a3e-8ac6-4980-8e6f-bbdbd3cc9264 req-5e2b9350-362a-484f-a558-af697a463fdb service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:14.330163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-26a30a3e-8ac6-4980-8e6f-bbdbd3cc9264 req-5e2b9350-362a-484f-a558-af697a463fdb service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:14.344220 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-26a30a3e-8ac6-4980-8e6f-bbdbd3cc9264 req-5e2b9350-362a-484f-a558-af697a463fdb service nova] Creating event network-vif-plugged:5b9e748a-ac62-44d0-8a29-73e5aa5ee509 for instance c9415985-9e06-4135-93bc-100cdb69e55c on hv-cinder-84517 Jun 15 00:48:14.349645 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-26a30a3e-8ac6-4980-8e6f-bbdbd3cc9264 req-5e2b9350-362a-484f-a558-af697a463fdb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Jun 15 00:48:14.350238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 444/850] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:48:14.440718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:14.449930 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8a7d6681-8f5a-4b9e-bb9e-bf8ef986fe3a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.159239 Jun 15 00:48:14.449930 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 407/851] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:14 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:15.466667 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:15.467354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:15.474393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:15.474837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:15.475581 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:15.476037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:15.604415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:15.611766 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2ab5d598-6ea5-4101-8cd6-f53fa9eb8702 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.150313 Jun 15 00:48:15.612400 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 445/852] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:15 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:16.628242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:16.628845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:16.635316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:16.635771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:16.636565 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:16.636999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:16.766533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:16.774183 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-39f10e32-d003-4765-94a3-92ae94e63c48 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1365 microversion: 2.1 time: 0.149736 Jun 15 00:48:16.778552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 408/853] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:16 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:48:17.535120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0420cd40-161f-40a9-bc2b-2d6af79a183d", "device": "/dev/sdb"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:17.536709 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:17.543011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.543450 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:17.544227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.544650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:17.790894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:17.791451 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:17.797857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.798296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:17.799073 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.799525 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:17.935237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:17.942931 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7ffaf867-be97-4add-9ab9-2c98880d9f3c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1555 microversion: 2.1 time: 0.155943 Jun 15 00:48:17.943491 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 409/854] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:17 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:48:17.958537 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:17.959020 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:17.964968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.970417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:17.970417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:17.970417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:18.047757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f1505102-59f6-4f4b-963d-f0ff33f83b6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092667 Jun 15 00:48:18.048657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 410/855] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:48:17 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:48:18.283992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cd151f91-4f13-482f-9e70-02c5dafc6dd1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "POST /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752540 Jun 15 00:48:18.288994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 446/856] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:48:17 2022] POST /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:48:19.000983 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e6cf8074-5e1f-4710-8091-5296afec9d3e req-f5f54ece-ff49-46b3-a9d1-94677b742167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9415985-9e06-4135-93bc-100cdb69e55c", "tag": "5b9e748a-ac62-44d0-8a29-73e5aa5ee509"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:19.009208 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e6cf8074-5e1f-4710-8091-5296afec9d3e req-f5f54ece-ff49-46b3-a9d1-94677b742167 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:19.012808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e6cf8074-5e1f-4710-8091-5296afec9d3e req-f5f54ece-ff49-46b3-a9d1-94677b742167 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:19.020841 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e6cf8074-5e1f-4710-8091-5296afec9d3e req-f5f54ece-ff49-46b3-a9d1-94677b742167 service nova] Creating event network-changed:5b9e748a-ac62-44d0-8a29-73e5aa5ee509 for instance c9415985-9e06-4135-93bc-100cdb69e55c on hv-cinder-84517 Jun 15 00:48:19.026277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e6cf8074-5e1f-4710-8091-5296afec9d3e req-f5f54ece-ff49-46b3-a9d1-94677b742167 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029350 Jun 15 00:48:19.026858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 411/857] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:48:42.966530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:42.967282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:42.971413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:42.975252 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:42.978086 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:42.978711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:42.979454 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:42.979938 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:43.063886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lazy-loading 'services' on Instance uuid 6cd3facf-4836-4eb2-be5f-10802ffd6061 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:48:43.227527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e8cce35d-c21f-485e-8ac0-9fb588205616 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061/os-volume_attachments/0420cd40-161f-40a9-bc2b-2d6af79a183d" status: 202 len: 0 microversion: 2.1 time: 0.262231 Jun 15 00:48:43.228081 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 447/858] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:48:42 2022] DELETE /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061/os-volume_attachments/0420cd40-161f-40a9-bc2b-2d6af79a183d => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:48:44.337845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=41 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:44.338587 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=85 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:44.342681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:44.343260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:44.349358 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:44.349799 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:44.350552 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:44.351055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:44.377424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:48:44.651069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5bfc79e3-b5bf-491b-a6d0-ae874cc082dd tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 204 len: 0 microversion: 2.1 time: 0.314669 Jun 15 00:48:44.651675 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 412/859] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:48:44 2022] DELETE /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:48:44.660630 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:44.662522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:44.667603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:44.668091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:44.669493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:44.669927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:44.798731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:44.806320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c2d2faa6-c2fd-47d9-a0c4-1b0f46378b7c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1512 microversion: 2.1 time: 0.150311 Jun 15 00:48:44.807240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 448/860] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:44 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:45.824019 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:45.824711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:45.830730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:45.831168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:45.831928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:45.832359 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:45.957260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:45.964634 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d75464e4-43c6-4b54-9a14-0a9c266d1003 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1512 microversion: 2.1 time: 0.144735 Jun 15 00:48:45.965194 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 413/861] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:45 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:46.982728 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:46.983321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:46.992826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:46.992826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:46.992826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:46.992826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:47.212289 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:47.220339 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8fea85f5-2837-499a-b070-cce75a2a5a47 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1512 microversion: 2.1 time: 0.241964 Jun 15 00:48:47.220912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 449/862] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:46 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:47.433147 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-a92deedd-1054-49e0-956a-10440ed13bd3 req-f53330a6-4651-4bf3-86f7-31628f914f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd3facf-4836-4eb2-be5f-10802ffd6061", "name": "network-vif-deleted", "tag": "48bc05bd-5121-48e1-a2a1-0190dc0bec97"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:47.441546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a92deedd-1054-49e0-956a-10440ed13bd3 req-f53330a6-4651-4bf3-86f7-31628f914f2f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:47.441985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-a92deedd-1054-49e0-956a-10440ed13bd3 req-f53330a6-4651-4bf3-86f7-31628f914f2f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:47.453530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-a92deedd-1054-49e0-956a-10440ed13bd3 req-f53330a6-4651-4bf3-86f7-31628f914f2f service nova] Creating event network-vif-deleted:48bc05bd-5121-48e1-a2a1-0190dc0bec97 for instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 on hv-cinder-84517 Jun 15 00:48:47.458521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-a92deedd-1054-49e0-956a-10440ed13bd3 req-f53330a6-4651-4bf3-86f7-31628f914f2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029011 Jun 15 00:48:47.459109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 414/863] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:48:48.237447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:48.237984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:48.244393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:48.244837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:48.245589 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:48.246018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:48.276159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:48.276595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:48.277031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lazy-loading 'fault' on Instance uuid 6cd3facf-4836-4eb2-be5f-10802ffd6061 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:48:48.319672 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:48:48.327192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9506c140-47b0-4ab7-969a-fa00c696246c tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 200 len: 1308 microversion: 2.1 time: 0.093569 Jun 15 00:48:48.327754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 450/864] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:48 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:48:49.344829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:48:49.345511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: 6cd3facf-4836-4eb2-be5f-10802ffd6061] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:48:49.352143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:49.352581 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:49.353322 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:48:49.353746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:48:49.366526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] HTTP exception thrown: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Request method failure captured: Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 HTTP/1.1 Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSwyxHKfX3-yQ8lUfEvoDiRM0ie40U2rj7mOnvEmlYUuKnQ6dS5RFNg67FiKk44_lyKbGr1oS79DdcDq5rebZuIkI_4db-GalRQ_DP5Q5AqKQ09Rv4kI6ViJ3u2xn38WkOBtx32XcAKrTs1iqIZI0pwrRpJX69Jwxulx8RXl7dxIR4M Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c0de2588b13e487a91aaf1ad7ea7bd6f Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:48:49.368123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c0de2588b13e487a91aaf1ad7ea7bd6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}] Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c0de2588b13e487a91aaf1ad7ea7bd6f Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotTestJSON-2128698914-project Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 513b7a90f9fe4d91aea642eae12b3753 Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128698914-project Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. Jun 15 00:48:49.369787 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '6cd3facf-4836-4eb2-be5f-10802ffd6061'} Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:48:49.370774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. Jun 15 00:48:49.379733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:48:49.381271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Returning 404 to user: Instance 6cd3facf-4836-4eb2-be5f-10802ffd6061 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:48:49.381271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-73e68827-1680-4c71-9cce-a0e73c056986 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061" status: 404 len: 111 microversion: 2.1 time: 0.028823 Jun 15 00:48:49.381271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 415/865] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:48:49 2022] GET /compute/v2.1/servers/6cd3facf-4836-4eb2-be5f-10802ffd6061 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:48:59.722721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-304755780", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "networks": [{"uuid": "2d047fe3-bb0d-4596-916d-c08afb9f5946"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:48:59.730118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=10 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:59.730784 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:59.780121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] validate_networks() for [('2d047fe3-bb0d-4596-916d-c08afb9f5946', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:49:00.120583 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:49:00.121000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:49:00.121461 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:49:00.121885 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:49:00.122329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:49:00.131551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:00.132022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:00.132804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:00.133226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:00.149260 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Getting quotas for project c0de2588b13e487a91aaf1ad7ea7bd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:49:00.152958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Getting quotas for user 513b7a90f9fe4d91aea642eae12b3753 and project c0de2588b13e487a91aaf1ad7ea7bd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:49:00.163364 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:49:00.165543 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:49:00.309077 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1371b76b-e284-4f26-89f1-c027c3fa8704 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590197 Jun 15 00:49:00.309888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 451/866] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:49:00.320440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-04d8cee9-61c6-44d8-8eda-bf0822db3866 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:00.321050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-04d8cee9-61c6-44d8-8eda-bf0822db3866 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:00.323617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:00.324289 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:00.376274 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-04d8cee9-61c6-44d8-8eda-bf0822db3866 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:00.382756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-04d8cee9-61c6-44d8-8eda-bf0822db3866 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1218 microversion: 2.1 time: 0.066254 Jun 15 00:49:00.383350 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 416/867] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:00 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:01.400401 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:01.401008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:01.407058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:01.407498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:01.408270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:01.408699 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:01.633493 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:01.641515 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-eae0ea99-e961-4bc3-af39-964f25b975b5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1214 microversion: 2.1 time: 0.245090 Jun 15 00:49:01.642076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 452/868] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:01 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:02.636265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:02.636853 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:02.644967 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.645404 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.646389 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.646922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.659663 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:02.660468 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:02.667451 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.668062 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.673421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.673421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.683174 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9e330ba0-687a-43a8-b538-91f465e45483 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/ips" status: 200 len: 150 microversion: 2.1 time: 0.051162 Jun 15 00:49:02.696728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 417/869] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:49:02 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:02.696728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cde3b04-687d-4616-8d3f-7c1cce290c74"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:02.697669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:02.705973 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.706424 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.707244 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.707767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.747934 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:02.756700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e8c64055-cdd1-4b1f-a0e3-0e9ad7fa2bbc tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1276 microversion: 2.1 time: 0.101787 Jun 15 00:49:02.757764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 453/870] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:02 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:02.814579 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: POST /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/os-volume_attachments HTTP/1.1 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 74 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:49:02.823090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {"volumeAttachment": {"volumeId": "1cde3b04-687d-4616-8d3f-7c1cce290c74"}} Jun 15 00:49:02.824898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'server_id': 'c9415985-9e06-4135-93bc-100cdb69e55c', 'body': {'volumeAttachment': {'volumeId': '1cde3b04-687d-4616-8d3f-7c1cce290c74'}}} Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:02.825870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:02.827510 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 400 to user: Invalid volume: volume 1cde3b04-687d-4616-8d3f-7c1cce290c74 is already attached to instances: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-af325952-8bbd-487d-a211-ac8b12d067fb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126099 Jun 15 00:49:02.830408 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 418/871] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:49:02 2022] POST /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:49:02.831330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:02.831330 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:02.836626 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.837272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.838065 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:02.838492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:02.863564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:49:03.165125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-133273a0-112e-456d-afe9-d0fa5ea6d38b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 204 len: 0 microversion: 2.1 time: 0.342239 Jun 15 00:49:03.168320 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 454/872] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:49:02 2022] DELETE /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:49:03.175944 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:03.176558 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:03.182769 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:03.183215 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:03.183999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:03.184430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:03.408578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:03.417751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3db954d7-30a2-41a5-9f55-eb534e4cc596 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1680 microversion: 2.1 time: 0.246695 Jun 15 00:49:03.418448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 419/873] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:03 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:03.775080 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:03.775871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:03.782844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:03.783287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:03.784070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:03.784501 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:03.915167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:03.922776 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-92135218-67b0-40eb-95ab-aff936ca2ef5 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.151953 Jun 15 00:49:03.923266 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 455/874] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:03 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:04.436127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:04.436976 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:04.443888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:04.444365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:04.445132 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:04.445564 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:04.807638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:04.815803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3835ed7e-77b5-4eb7-bf52-12055e0353d5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1680 microversion: 2.1 time: 0.383606 Jun 15 00:49:04.816391 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 420/875] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:04 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1680 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:04.939216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:04.939826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:04.946275 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:04.946870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:04.947458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:04.947893 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:05.152384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:05.161487 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-40fc3ca3-5f4c-4250-8681-66917f3703d9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.226682 Jun 15 00:49:05.162251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 456/876] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:04 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:05.334491 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-eaeb68ac-168a-4abb-a670-832cc22a8a68 req-707c9b5f-6769-4ecc-b552-5ef86ab916c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef814c2-30ed-4a1d-a18d-955ba4ca1da5", "tag": "757f163d-8fd3-434f-99fd-887590b74f55"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:05.350303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-eaeb68ac-168a-4abb-a670-832cc22a8a68 req-707c9b5f-6769-4ecc-b552-5ef86ab916c2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:05.352066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-eaeb68ac-168a-4abb-a670-832cc22a8a68 req-707c9b5f-6769-4ecc-b552-5ef86ab916c2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:05.362661 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-eaeb68ac-168a-4abb-a670-832cc22a8a68 req-707c9b5f-6769-4ecc-b552-5ef86ab916c2 service nova] Creating event network-changed:757f163d-8fd3-434f-99fd-887590b74f55 for instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 on hv-cinder-84517 Jun 15 00:49:05.367721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-eaeb68ac-168a-4abb-a670-832cc22a8a68 req-707c9b5f-6769-4ecc-b552-5ef86ab916c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036931 Jun 15 00:49:05.368430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 421/877] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:49:05.834366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:05.835665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:05.852638 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:05.853083 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:05.853852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:05.854286 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:05.932614 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:05.942259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-933566d7-6594-4319-83f7-dcf832ea1cf6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1612 microversion: 2.1 time: 0.112024 Jun 15 00:49:05.948660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 457/878] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:05 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1612 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:06.181155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:06.181869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:06.193822 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:06.194302 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:06.195068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:06.195495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:06.200505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-78f33f1b-4e3f-4b47-b755-72e61df28e9d req-99270d0f-ad61-4deb-917d-64dd8843926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9415985-9e06-4135-93bc-100cdb69e55c", "name": "network-vif-deleted", "tag": "5b9e748a-ac62-44d0-8a29-73e5aa5ee509"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:06.210925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-78f33f1b-4e3f-4b47-b755-72e61df28e9d req-99270d0f-ad61-4deb-917d-64dd8843926b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:06.212102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-78f33f1b-4e3f-4b47-b755-72e61df28e9d req-99270d0f-ad61-4deb-917d-64dd8843926b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:06.225910 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-78f33f1b-4e3f-4b47-b755-72e61df28e9d req-99270d0f-ad61-4deb-917d-64dd8843926b service nova] Creating event network-vif-deleted:5b9e748a-ac62-44d0-8a29-73e5aa5ee509 for instance c9415985-9e06-4135-93bc-100cdb69e55c on hv-cinder-84517 Jun 15 00:49:06.231393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-78f33f1b-4e3f-4b47-b755-72e61df28e9d req-99270d0f-ad61-4deb-917d-64dd8843926b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039608 Jun 15 00:49:06.232253 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 458/879] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:06.336598 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:06.345765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b83c6766-eed9-4785-a96b-188e108b106f tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.171114 Jun 15 00:49:06.346439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 422/880] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:06 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:06.960354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:06.961053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:06.967538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:06.968009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:06.968940 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:06.969198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:07.034214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:07.042063 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-63e641a9-0b20-404a-9f76-5eb1f69a67c1 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1324 microversion: 2.1 time: 0.085955 Jun 15 00:49:07.042745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 459/881] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:06 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1324 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:07.362817 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:07.364081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:07.370806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:07.371251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:07.372065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:07.372838 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:07.498055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:07.505924 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-325224f2-52eb-4695-b75c-d41cb8580546 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.147155 Jun 15 00:49:07.506483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 423/882] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:07 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:08.059605 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:08.060259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:08.066825 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:08.067262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:08.068038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:08.068465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:08.100539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:08.100981 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:08.102020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'fault' on Instance uuid c9415985-9e06-4135-93bc-100cdb69e55c {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:49:08.144967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:08.151802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-51b350c4-5a25-44c2-b970-33abb5672993 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 200 len: 1329 microversion: 2.1 time: 0.096177 Jun 15 00:49:08.152560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 460/883] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:08 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:08.522754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:08.523294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:08.529852 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:08.530305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:08.531065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:08.532140 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:08.655297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:08.663248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-71d9aa50-59ed-47bc-970a-bfd2c65ac251 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.144401 Jun 15 00:49:08.663808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 424/884] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:08 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:09.169737 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:09.170343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:09.177377 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:09.177823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:09.178582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:09.179013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:09.193245 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c HTTP/1.1 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:49:09.194894 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:49:09.196966 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'c9415985-9e06-4135-93bc-100cdb69e55c'} Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:49:09.198050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:49:09.199366 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:09.200483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:49:09.200483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-deae6e31-efd0-477e-8f2b-4a9313f449ef tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 404 len: 111 microversion: 2.1 time: 0.030530 Jun 15 00:49:09.200483 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 461/885] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:09 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:49:09.206471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2aecf551-bed5-41b3-92ba-5a9cea7933c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '.version_select at 0x7fa81f6b9f70>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:09.257942 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2aecf551-bed5-41b3-92ba-5a9cea7933c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848002657" status: 202 len: 0 microversion: 2.1 time: 0.055923 Jun 15 00:49:09.258511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 425/886] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jun 15 00:49:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848002657 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:49:09.679239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:09.679849 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:09.685831 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:09.686277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:09.687036 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:09.688437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:09.859558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:09.867022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-61ba0ec0-4d18-4283-9161-4119ea6f0ac6 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.191608 Jun 15 00:49:09.867573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 462/887] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:09 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:10.095921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:10.096508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:10.102701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.103141 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:10.103888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.104334 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:10.182486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'services' on Instance uuid a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:49:10.380193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:10.387665 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5f0770b2-d1d3-4fca-9a9b-cf2596217905 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments/1cde3b04-687d-4616-8d3f-7c1cce290c74" status: 202 len: 0 microversion: 2.1 time: 0.296202 Jun 15 00:49:10.388280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 426/888] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:49:10 2022] DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments/1cde3b04-687d-4616-8d3f-7c1cce290c74 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:49:10.397394 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:10.398373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:10.400465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:10.401121 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:10.405887 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.406353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:10.407099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.407524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:10.435448 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8d2d0ec7-aa5f-42ce-ab1c-47fe06ca48c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Jun 15 00:49:10.436012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 463/889] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:49:10 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:10.884549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:10.885161 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:10.893148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.893633 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:10.894389 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:10.894816 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:11.024628 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:11.032310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7a57db4a-e355-4885-b331-43cbad7832f8 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.152058 Jun 15 00:49:11.032875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 427/890] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:10 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:11.106254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-b9b23a38-9930-443f-968a-c01edb6173af req-b3db3556-8e35-4f43-a1dc-bd77a7794cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef814c2-30ed-4a1d-a18d-955ba4ca1da5", "name": "network-vif-plugged", "status": "completed", "tag": "757f163d-8fd3-434f-99fd-887590b74f55"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:11.115519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b9b23a38-9930-443f-968a-c01edb6173af req-b3db3556-8e35-4f43-a1dc-bd77a7794cec service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:11.115980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b9b23a38-9930-443f-968a-c01edb6173af req-b3db3556-8e35-4f43-a1dc-bd77a7794cec service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:11.127274 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-b9b23a38-9930-443f-968a-c01edb6173af req-b3db3556-8e35-4f43-a1dc-bd77a7794cec service nova] Creating event network-vif-plugged:757f163d-8fd3-434f-99fd-887590b74f55 for instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 on hv-cinder-84517 Jun 15 00:49:11.132561 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-b9b23a38-9930-443f-968a-c01edb6173af req-b3db3556-8e35-4f43-a1dc-bd77a7794cec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Jun 15 00:49:11.133198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 464/891] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:11.446831 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:11.447691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:11.454077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:11.454523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:11.457017 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:11.457017 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:11.489349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-697f404b-e1db-4af5-9d78-c447c89aaf25 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Jun 15 00:49:11.492056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 428/892] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:49:11 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:12.050401 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:12.051079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:12.057799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.058240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.058981 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.059406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.189382 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:12.197028 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5cb309f2-4194-4840-8ec5-006c9cc75499 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.151662 Jun 15 00:49:12.198126 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 465/893] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:12 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:12.501216 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:12.502120 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:12.508545 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.509004 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.509747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.510177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.539556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-12bb6896-58a2-416e-b5fa-d70ef5709853 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042924 Jun 15 00:49:12.540475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 429/894] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:49:12 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:49:12.605464 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:12.605952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:12.611899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.616436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.616436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.616436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.639295 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:49:12.736617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:12.872948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-464ed9bc-5327-47eb-ad6c-3a43c76fb8db tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 204 len: 0 microversion: 2.1 time: 0.270986 Jun 15 00:49:12.873533 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 466/895] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:49:12 2022] DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:49:12.886774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:12.886774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:12.888702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.889131 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:12.889890 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:12.890324 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:13.013945 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:13.021668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9c87dc1a-db3f-455b-9a67-8e689f54831f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1682 microversion: 2.1 time: 0.143394 Jun 15 00:49:13.022231 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 430/896] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:12 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1682 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:13.216000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:13.216602 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:13.223819 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:13.224597 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:13.225134 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:13.225560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:13.355654 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:13.363646 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6ed95013-b10c-41e0-9b09-02f5987cf7ab tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1318 microversion: 2.1 time: 0.152084 Jun 15 00:49:13.364233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 467/897] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:13 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:14.039191 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:14.039822 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:14.046270 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.046716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:14.047468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.047898 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:14.171857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:14.179243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5661ba8a-401e-42b2-9f3f-5dd64aa126ad tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1682 microversion: 2.1 time: 0.143892 Jun 15 00:49:14.179806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 431/898] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:14 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:14.381015 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:14.381551 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:14.388011 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.388522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:14.389273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.389701 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:14.512840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:14.520397 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f152eefe-06e1-404e-81b7-9cfae95ca8e2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1506 microversion: 2.1 time: 0.143255 Jun 15 00:49:14.520962 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 468/899] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:14 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1506 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:14.536412 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e43ac92-5e18-4709-a1ae-7188cda8e675", "device": "/dev/sdb"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:14.538046 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:14.543988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.544456 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:14.545205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:14.545632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:15.196903 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:15.197499 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:15.203711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:15.204844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:15.204979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:15.205383 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:15.337627 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:15.345174 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aad69caf-eaea-40fd-8af5-738c2cce0fdf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1682 microversion: 2.1 time: 0.152324 Jun 15 00:49:15.345771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 469/900] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:15 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:49:15.449291 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a8cebc9b-b69c-42af-be8c-69cf5557d4d2 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "POST /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916606 Jun 15 00:49:15.450232 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 432/901] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:49:14 2022] POST /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:15.862901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-11980d35-4d67-423b-8cd6-2203f4db5849 req-43538689-0c89-4808-a60f-039d0eac9aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1", "name": "network-vif-deleted", "tag": "3bd0627a-f513-4c34-a89e-9297cd2fe115"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:15.871238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-11980d35-4d67-423b-8cd6-2203f4db5849 req-43538689-0c89-4808-a60f-039d0eac9aa3 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:15.871941 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-11980d35-4d67-423b-8cd6-2203f4db5849 req-43538689-0c89-4808-a60f-039d0eac9aa3 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:15.883600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-11980d35-4d67-423b-8cd6-2203f4db5849 req-43538689-0c89-4808-a60f-039d0eac9aa3 service nova] Creating event network-vif-deleted:3bd0627a-f513-4c34-a89e-9297cd2fe115 for instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 on hv-cinder-84517 Jun 15 00:49:15.888600 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-11980d35-4d67-423b-8cd6-2203f4db5849 req-43538689-0c89-4808-a60f-039d0eac9aa3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029554 Jun 15 00:49:15.889547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 470/902] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:16.363582 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:16.364304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:16.370771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:16.371337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:16.372146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:16.375366 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:16.392822 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:16.406080 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:16.406533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:16.406980 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'fault' on Instance uuid a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:49:16.447376 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:16.455934 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f682502b-516d-45e3-bcb3-fb8782ebfe61 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 200 len: 1332 microversion: 2.1 time: 0.097101 Jun 15 00:49:16.457094 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 433/903] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:16 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:17.475471 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:17.476218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:17.482378 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:17.482829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:17.483629 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:17.484105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:17.497009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 HTTP/1.1 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:49:17.498580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:49:17.500305 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1'} Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:49:17.501179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:49:17.502720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:49:17.504002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:49:17.504002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-26716580-cdfd-44e3-a70f-1d93c12b12b5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 404 len: 111 microversion: 2.1 time: 0.029173 Jun 15 00:49:17.504002 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 471/904] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:17 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:49:17.508508 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3b28b8ab-e7c2-4ac5-83b4-7eba6afa4c99 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '.version_select at 0x7fa81f6e4670>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:17.611702 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3b28b8ab-e7c2-4ac5-83b4-7eba6afa4c99 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068980314" status: 202 len: 0 microversion: 2.1 time: 0.106886 Jun 15 00:49:17.623393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 434/905] 10.222.0.17 () {58 vars in 1220 bytes} [Wed Jun 15 00:49:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068980314 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:49:18.326462 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-3b0e41a7-23b7-498b-966b-dc85ea8f1cde tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: .version_select at 0x7fa81f761d30>, body: {"keypair": {"name": "tempest-keypair-288547424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF6V+0BarY+mMAYmu4cL1zkMEVcdmx9txgjm3FN46yAumMxIAKBf8tG61FZxpmNd6wOYlBwW/d838UF4MdKn+eibKC9pNSuVvYyvloU/d7uE1BznSETe0iHYy04uXYXgw=="}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:18.340346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-3b0e41a7-23b7-498b-966b-dc85ea8f1cde tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:49:18.344123 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-3b0e41a7-23b7-498b-966b-dc85ea8f1cde tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:49:18.411253 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-3b0e41a7-23b7-498b-966b-dc85ea8f1cde tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088673 Jun 15 00:49:18.411833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 472/906] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:49:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:20.493002 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1055948374", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "745875bd-db66-4942-8b94-73869e4acd94"}], "security_groups": [{"name": "tempest-securitygroup--1101855790"}], "key_name": "tempest-keypair-288547424", "user_data": "}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:20.590115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] validate_networks() for [('745875bd-db66-4942-8b94-73869e4acd94', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:49:20.948917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:49:20.949448 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:49:20.949922 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:49:20.950329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:49:20.950739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:49:20.960407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:20.960855 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:20.961655 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:20.962090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:20.978993 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:49:20.983185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:49:20.994406 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:49:20.996751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:49:21.097730 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bb8edc66-3be9-49ff-a3ff-156797ad158f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609498 Jun 15 00:49:21.098584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 435/907] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:49:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:49:21.109411 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dfab4021-9bd9-4182-bab5-27e96828c481 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:21.109411 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dfab4021-9bd9-4182-bab5-27e96828c481 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:21.163118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-dfab4021-9bd9-4182-bab5-27e96828c481 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:21.170651 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dfab4021-9bd9-4182-bab5-27e96828c481 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1241 microversion: 2.1 time: 0.066267 Jun 15 00:49:21.171212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 473/908] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:21 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:22.189426 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:22.190050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:22.196646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:22.197107 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:22.197856 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:22.198286 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:22.257884 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:22.265117 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5f24f659-9ea9-412d-86ac-cccf6cd040d0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1237 microversion: 2.1 time: 0.080884 Jun 15 00:49:22.265669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 436/909] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:22 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:23.282139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:23.282878 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:23.290562 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:23.291042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:23.291814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:23.292302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:23.364250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:23.371839 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-993b4c9a-f088-434f-a07b-893868452e4d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1301 microversion: 2.1 time: 0.093648 Jun 15 00:49:23.372474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 474/910] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:23 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:24.389418 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:24.389954 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:24.397246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:24.397691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:24.398442 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:24.398869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:24.525328 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:24.532611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-47148876-fc5f-4841-bb06-229fe266e59c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.147026 Jun 15 00:49:24.533162 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 437/911] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:24 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:25.550228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:25.550823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:25.557218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:25.557658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:25.558401 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:25.558824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:25.681968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:25.689541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-55e7ab34-ea16-4a80-8f69-746404ce1bc8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.143841 Jun 15 00:49:25.690096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 475/912] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:25 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:26.706124 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:26.706733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:26.712915 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:26.713377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:26.714122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:26.714553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:26.874995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:26.883154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f1ccbe3b-2295-4cbc-a191-9d843ab331dc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.180803 Jun 15 00:49:26.884533 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 438/913] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:26 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:27.122536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-cef384d7-afab-441b-9afb-f8f85a4954c4 req-bab53197-0385-4a9f-9115-4c013dff2826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d61fee4-ff95-454f-8566-dbbef8ef7fa6", "tag": "53dc1bbd-80f6-493f-8cc9-28189d844586"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:27.136031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-cef384d7-afab-441b-9afb-f8f85a4954c4 req-bab53197-0385-4a9f-9115-4c013dff2826 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:27.136031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-cef384d7-afab-441b-9afb-f8f85a4954c4 req-bab53197-0385-4a9f-9115-4c013dff2826 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:27.154812 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-cef384d7-afab-441b-9afb-f8f85a4954c4 req-bab53197-0385-4a9f-9115-4c013dff2826 service nova] Creating event network-changed:53dc1bbd-80f6-493f-8cc9-28189d844586 for instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 on hv-cinder-84517 Jun 15 00:49:27.159807 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-cef384d7-afab-441b-9afb-f8f85a4954c4 req-bab53197-0385-4a9f-9115-4c013dff2826 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Jun 15 00:49:27.160458 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 476/914] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:27.900640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:27.902657 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:27.908090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:27.908537 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:27.909364 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:27.909795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:28.035985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:28.043585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-11412ada-92e4-45b5-a813-708386337c68 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.146805 Jun 15 00:49:28.044186 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 439/915] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:27 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:29.061253 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:29.061948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:29.068141 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:29.068584 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:29.069754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:29.070539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:29.196875 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:29.204212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-510896e8-343e-4624-ad71-4b6a97f7081c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.147634 Jun 15 00:49:29.204775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 477/916] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:29 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:30.221371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:30.221978 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:30.228511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:30.228956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:30.229707 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:30.230138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:30.355921 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:30.363697 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7d5a3bcc-2497-4682-a1ac-d4bb4ce561c7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.146448 Jun 15 00:49:30.364292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 440/917] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:30 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:31.380216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:31.380820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:31.383259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:31.383923 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:31.388811 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:31.389254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:31.390012 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:31.390438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:31.517140 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:31.524387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-659bf274-9a4c-4c1a-a13b-bc6152c87eba tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.147954 Jun 15 00:49:31.524948 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 478/918] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:31 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:49:32.541338 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:32.542015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:32.543813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:32.544488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:32.549771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:32.550219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:32.550980 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:32.551606 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:32.684716 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:32.692828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4b8047e6-e929-473c-a3a0-d817a1f5b9c3 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.155475 Jun 15 00:49:32.693384 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 441/919] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:32 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:33.710055 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:33.710655 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:33.717165 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:33.717609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:33.718357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:33.719293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:33.843460 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:33.851304 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fa198cd2-08e2-4348-8c32-605a123596ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.145434 Jun 15 00:49:33.851871 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 479/920] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:33 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:34.629850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-991f3b89-3498-4c62-9458-90b54e7d4bca req-08906f63-6a91-41e9-8702-76437540684d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d61fee4-ff95-454f-8566-dbbef8ef7fa6", "name": "network-vif-plugged", "status": "completed", "tag": "53dc1bbd-80f6-493f-8cc9-28189d844586"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:34.634298 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:34.639686 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-991f3b89-3498-4c62-9458-90b54e7d4bca req-08906f63-6a91-41e9-8702-76437540684d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:34.646237 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-991f3b89-3498-4c62-9458-90b54e7d4bca req-08906f63-6a91-41e9-8702-76437540684d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:34.650939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-991f3b89-3498-4c62-9458-90b54e7d4bca req-08906f63-6a91-41e9-8702-76437540684d service nova] Creating event network-vif-plugged:53dc1bbd-80f6-493f-8cc9-28189d844586 for instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 on hv-cinder-84517 Jun 15 00:49:34.655802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-991f3b89-3498-4c62-9458-90b54e7d4bca req-08906f63-6a91-41e9-8702-76437540684d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jun 15 00:49:34.656427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 442/921] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:34.867830 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:34.868457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:34.875568 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:34.876037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:34.876978 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:34.877403 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:35.002964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:35.011067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5610ed15-b2b0-4afd-bd6d-0cc1bb850f95 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.147150 Jun 15 00:49:35.011778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 480/922] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:34 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:35.332288 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:35.332866 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:35.339593 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:35.340069 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:35.340832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:35.341276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:35.423083 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lazy-loading 'services' on Instance uuid cef814c2-30ed-4a1d-a18d-955ba4ca1da5 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:49:35.569187 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-90580387-3646-441b-a99b-09a4ee87a095 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5/os-volume_attachments/8e43ac92-5e18-4709-a1ae-7188cda8e675" status: 202 len: 0 microversion: 2.1 time: 0.241489 Jun 15 00:49:35.569698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 443/923] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:49:35 2022] DELETE /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5/os-volume_attachments/8e43ac92-5e18-4709-a1ae-7188cda8e675 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:49:36.028402 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:36.029029 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:36.035408 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:36.035847 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:36.036695 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:36.037118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:36.166822 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:36.174615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-53d5ff62-bccf-4688-9aa4-9f01a6b3d98c tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1367 microversion: 2.1 time: 0.150033 Jun 15 00:49:36.175168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 481/924] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:36 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:37.192169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:37.192882 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:37.199284 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.199727 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.200493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.200919 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.331933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:37.340012 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8082a592-71f9-45e3-9527-7b01427de1df tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1558 microversion: 2.1 time: 0.153170 Jun 15 00:49:37.340568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 444/925] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:37 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:37.356813 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:37.357340 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:37.363801 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.364281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.365042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.365474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.445413 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-dbc216f1-9321-4f69-b490-1f1e44800c60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092519 Jun 15 00:49:37.446000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 482/926] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:49:37 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:37.732765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:37.732765 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:37.738144 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.738593 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.739367 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:37.739806 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:37.766035 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:49:38.039143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1be77f6b-1c43-4b36-b8a9-6ef4386c6cf4 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 204 len: 0 microversion: 2.1 time: 0.312109 Jun 15 00:49:38.039867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 445/927] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:49:37 2022] DELETE /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:49:38.048745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:38.049353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:38.055423 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:38.055870 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:38.056732 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:38.057167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:38.239511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:38.247203 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-358d228f-042f-4963-9b26-b677f3643e65 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1512 microversion: 2.1 time: 0.203013 Jun 15 00:49:38.247763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 483/928] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:38 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:38.707291 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-bb9f9a52-36a6-4331-ad68-dccaf16a34ec req-6582c0e3-179d-4dcf-bf28-6437bb26321f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d61fee4-ff95-454f-8566-dbbef8ef7fa6", "tag": "53dc1bbd-80f6-493f-8cc9-28189d844586"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:38.715972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bb9f9a52-36a6-4331-ad68-dccaf16a34ec req-6582c0e3-179d-4dcf-bf28-6437bb26321f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:38.716500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bb9f9a52-36a6-4331-ad68-dccaf16a34ec req-6582c0e3-179d-4dcf-bf28-6437bb26321f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:38.727929 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-bb9f9a52-36a6-4331-ad68-dccaf16a34ec req-6582c0e3-179d-4dcf-bf28-6437bb26321f service nova] Creating event network-changed:53dc1bbd-80f6-493f-8cc9-28189d844586 for instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 on hv-cinder-84517 Jun 15 00:49:38.732916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-bb9f9a52-36a6-4331-ad68-dccaf16a34ec req-6582c0e3-179d-4dcf-bf28-6437bb26321f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030186 Jun 15 00:49:38.733437 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 446/929] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:39.264316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:39.264839 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:39.272186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:39.272623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:39.273371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:39.273799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:39.401995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:39.410208 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e014cb87-7663-40ca-9d5c-8527ea729be1 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1512 microversion: 2.1 time: 0.149747 Jun 15 00:49:39.410773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 484/930] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:39 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:40.427972 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:40.428670 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:40.434888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:40.435330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:40.436226 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:40.436656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:40.497648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513b7a90f9fe4d91aea642eae12b3753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:49:40.509659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-086dd1a3-6097-4a08-adc0-65bdf28c59b9 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 200 len: 1470 microversion: 2.1 time: 0.086478 Jun 15 00:49:40.510414 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 447/931] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:40 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 1470 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:49:40.747771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-f5fd48b8-38be-4dc0-9368-36275702c86f req-3ebb471d-ac3e-47fa-9242-68bb6a2e3830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef814c2-30ed-4a1d-a18d-955ba4ca1da5", "name": "network-vif-deleted", "tag": "757f163d-8fd3-434f-99fd-887590b74f55"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:49:40.756284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-f5fd48b8-38be-4dc0-9368-36275702c86f req-3ebb471d-ac3e-47fa-9242-68bb6a2e3830 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:40.756729 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-f5fd48b8-38be-4dc0-9368-36275702c86f req-3ebb471d-ac3e-47fa-9242-68bb6a2e3830 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:40.767524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-f5fd48b8-38be-4dc0-9368-36275702c86f req-3ebb471d-ac3e-47fa-9242-68bb6a2e3830 service nova] Creating event network-vif-deleted:757f163d-8fd3-434f-99fd-887590b74f55 for instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 on hv-cinder-84517 Jun 15 00:49:40.772474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-f5fd48b8-38be-4dc0-9368-36275702c86f req-3ebb471d-ac3e-47fa-9242-68bb6a2e3830 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028500 Jun 15 00:49:40.773047 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 485/932] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:49:41.527567 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:49:41.528107 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] [instance: cef814c2-30ed-4a1d-a18d-955ba4ca1da5] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:49:41.535737 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:41.535737 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:41.536344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:49:41.536775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:49:41.549905 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] HTTP exception thrown: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Request method failure captured: Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 HTTP/1.1 Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSwyxHKfX3-yQ8lUfEvoDiRM0ie40U2rj7mOnvEmlYUuKnQ6dS5RFNg67FiKk44_lyKbGr1oS79DdcDq5rebZuIkI_4db-GalRQ_DP5Q5AqKQ09Rv4kI6ViJ3u2xn38WkOBtx32XcAKrTs1iqIZI0pwrRpJX69Jwxulx8RXl7dxIR4M Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c0de2588b13e487a91aaf1ad7ea7bd6f Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:49:41.551550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c0de2588b13e487a91aaf1ad7ea7bd6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c0de2588b13e487a91aaf1ad7ea7bd6f"}]}] Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c0de2588b13e487a91aaf1ad7ea7bd6f Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2128698914 Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-VolumesSnapshotTestJSON-2128698914-project Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 513b7a90f9fe4d91aea642eae12b3753 Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-VolumesSnapshotTestJSON-2128698914-project Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. Jun 15 00:49:41.553115 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': 'cef814c2-30ed-4a1d-a18d-955ba4ca1da5'} Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:49:41.553953 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. Jun 15 00:49:41.555434 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:49:41.556900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] Returning 404 to user: Instance cef814c2-30ed-4a1d-a18d-955ba4ca1da5 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:49:41.556900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a360a218-567b-467b-986d-59adb7cb65e3 tempest-VolumesSnapshotTestJSON-2128698914 tempest-VolumesSnapshotTestJSON-2128698914-project] 10.222.0.17 "GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5" status: 404 len: 111 microversion: 2.1 time: 0.029359 Jun 15 00:49:41.556900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 448/933] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:49:41 2022] GET /compute/v2.1/servers/cef814c2-30ed-4a1d-a18d-955ba4ca1da5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:50:19.597525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=15 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:19.598734 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:19.603219 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:19.607003 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:19.609826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:19.610272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:19.611017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:19.611447 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:19.635115 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b4124067-3e22-4261-bb63-c41a45e5db4b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/ips" status: 200 len: 151 microversion: 2.1 time: 0.039228 Jun 15 00:50:19.640060 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 486/934] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:50:19 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:21.232398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe3ec515-6262-4410-baf5-fb69a90ec1ea"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:21.237171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:21.237171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:21.237171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:21.241142 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:21.241607 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:21.242417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:21.242850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:22.036111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a5506c7-5663-4b04-84ca-02010cb32ebc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807449 Jun 15 00:50:22.036698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 449/935] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:50:21 2022] POST /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:29.516667 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe3ec515-6262-4410-baf5-fb69a90ec1ea"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:29.517977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:29.525367 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.525809 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:29.526567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.526996 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:29.660075 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: POST /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments HTTP/1.1 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 74 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:50:29.661793 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {"volumeAttachment": {"volumeId": "fe3ec515-6262-4410-baf5-fb69a90ec1ea"}} Jun 15 00:50:29.663319 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '0d61fee4-ff95-454f-8566-dbbef8ef7fa6', 'body': {'volumeAttachment': {'volumeId': 'fe3ec515-6262-4410-baf5-fb69a90ec1ea'}}} Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:50:29.664130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:29.665347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 400 to user: Invalid volume: volume fe3ec515-6262-4410-baf5-fb69a90ec1ea is already attached to instances: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c719d4de-97cc-4b99-a8a6-d182c257847f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150514 Jun 15 00:50:29.666599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 487/936] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:50:29 2022] POST /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 00:50:29.723943 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:29.724526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:29.730640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.731081 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:29.731830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.732692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:29.815155 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'services' on Instance uuid 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:50:29.980842 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-494887c2-b3f9-43da-8d04-640d5d64c4ed tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments/fe3ec515-6262-4410-baf5-fb69a90ec1ea" status: 202 len: 0 microversion: 2.1 time: 0.260847 Jun 15 00:50:29.981422 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 450/937] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:50:29 2022] DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments/fe3ec515-6262-4410-baf5-fb69a90ec1ea => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:50:29.989688 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:29.991512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:29.998299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.998747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:29.999512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:29.999971 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:30.028373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a958f8ef-d765-45d6-8328-23b1d09a98ca tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Jun 15 00:50:30.028919 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 488/938] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:50:29 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:31.041056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:31.042345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:31.054305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:31.054305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:31.054305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:31.054305 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:31.079241 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-95031c9b-6e95-42e9-a7b3-c691c95fb5d8 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jun 15 00:50:31.079795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 451/939] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:50:31 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:32.090775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:32.091684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:32.098085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.098524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.099268 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.099693 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.126741 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4cd96a59-85a7-4463-9098-440e077a6e6f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040711 Jun 15 00:50:32.127261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 489/940] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:50:32 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:50:32.182781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:32.183302 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:32.189845 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.190294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.191046 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.191479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.216767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:50:32.496170 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b3b099de-fdba-44fb-92bc-3f2c30f41e17 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 204 len: 0 microversion: 2.1 time: 0.316270 Jun 15 00:50:32.496660 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 452/941] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:50:32 2022] DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:50:32.504868 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:32.505475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:32.512193 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.512641 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.513427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:32.513861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:32.645216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:32.652623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-41c046d5-3ea9-4acd-a5d5-b5577db1fade tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1683 microversion: 2.1 time: 0.151583 Jun 15 00:50:32.653179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 490/942] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:32 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:50:33.670271 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:33.670956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:33.677343 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:33.677785 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:33.678530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:33.678956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:33.804397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:33.811824 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1cd0ea30-b8f2-4c4f-8ec1-74a1348bb1c0 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1683 microversion: 2.1 time: 0.145886 Jun 15 00:50:33.812419 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 453/943] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:33 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:34.828393 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:34.829000 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:34.835398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:34.835849 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:34.836628 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:34.837061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:35.006445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:35.014465 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-51686ebd-3789-47c7-8dd3-de88932a4065 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1683 microversion: 2.1 time: 0.189934 Jun 15 00:50:35.020192 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 491/944] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:34 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:35.328870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-c746dc3c-d5fa-441b-8532-7c45f0068c33 req-f58c5225-9297-475c-9ded-6e7b07247b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d61fee4-ff95-454f-8566-dbbef8ef7fa6", "name": "network-vif-deleted", "tag": "53dc1bbd-80f6-493f-8cc9-28189d844586"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:35.337796 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c746dc3c-d5fa-441b-8532-7c45f0068c33 req-f58c5225-9297-475c-9ded-6e7b07247b43 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:35.338260 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-c746dc3c-d5fa-441b-8532-7c45f0068c33 req-f58c5225-9297-475c-9ded-6e7b07247b43 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:35.349662 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-c746dc3c-d5fa-441b-8532-7c45f0068c33 req-f58c5225-9297-475c-9ded-6e7b07247b43 service nova] Creating event network-vif-deleted:53dc1bbd-80f6-493f-8cc9-28189d844586 for instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 on hv-cinder-84517 Jun 15 00:50:35.354483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-c746dc3c-d5fa-441b-8532-7c45f0068c33 req-f58c5225-9297-475c-9ded-6e7b07247b43 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029359 Jun 15 00:50:35.355091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 454/945] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:36.033570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:36.034242 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:36.041001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:36.041537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:36.042329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:36.043118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:36.075958 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:36.076479 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:36.076922 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'fault' on Instance uuid 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:50:36.120560 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:36.128321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-45f10bc3-1df4-4451-9964-776147bc9bd2 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 200 len: 1331 microversion: 2.1 time: 0.099000 Jun 15 00:50:36.128890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 492/946] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:36 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:37.148146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:37.148833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:37.155466 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:37.155920 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:37.156675 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:37.157102 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:37.170397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 HTTP/1.1 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:50:37.171974 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:50:37.173486 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '0d61fee4-ff95-454f-8566-dbbef8ef7fa6'} Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:50:37.174278 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:50:37.175775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:50:37.177236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:50:37.177236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b7bb5306-7f89-4107-8a52-c8545eec8124 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 404 len: 111 microversion: 2.1 time: 0.029911 Jun 15 00:50:37.177236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 455/947] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:37 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:50:37.182020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f65095de-003a-4d6e-9e55-18a65278b549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '.version_select at 0x7fa8240680d0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:37.244457 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f65095de-003a-4d6e-9e55-18a65278b549 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288547424" status: 202 len: 0 microversion: 2.1 time: 0.066102 Jun 15 00:50:37.245067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 493/948] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jun 15 00:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288547424 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:50:38.161106 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-556b3d4f-4f35-4602-b602-eafef8066824 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: .version_select at 0x7fa81f707940>, body: {"keypair": {"name": "tempest-keypair-257845557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8RnFrTXiqQrCU3SR3hVnlnznVEBPVNkmihgulGOt7c2HI4CXh5Ve9nOyzFn7NsyhCXpxe+3w24d+TvqLAvyaKwOmw2SNmZXT6H8ZLFZCpW23YvXq539HvLyG1VYrRJKg=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:38.175987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-556b3d4f-4f35-4602-b602-eafef8066824 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:50:38.179707 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-556b3d4f-4f35-4602-b602-eafef8066824 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:50:38.261728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-556b3d4f-4f35-4602-b602-eafef8066824 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104529 Jun 15 00:50:38.262323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 456/949] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:50:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:40.334643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-23117417", "imageRef": "c2a9426a-e292-4b59-be31-3118f2a1e37e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "745875bd-db66-4942-8b94-73869e4acd94"}], "security_groups": [{"name": "tempest-securitygroup--113801384"}], "key_name": "tempest-keypair-257845557", "user_data": "}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:40.433656 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] validate_networks() for [('745875bd-db66-4942-8b94-73869e4acd94', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:50:40.800820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:50:40.801261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:50:40.801773 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:50:40.802167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:50:40.802563 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:50:40.811270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:40.811704 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:40.812517 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:40.812962 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:40.828883 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:50:40.832724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Getting quotas for user 3e857898104242699e7590b527c2631f and project c73dcc78ab7c47abbb0dceebb5e212f2. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:50:40.843786 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:50:40.845994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2a9426a-e292-4b59-be31-3118f2a1e37e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:50:40.959541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-774a66f3-843f-453c-b92c-174696b5777d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.629349 Jun 15 00:50:40.960270 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 494/950] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:50:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:50:40.971201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-81782eb5-5410-4a60-90cf-0127e7e4157b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:40.971800 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-81782eb5-5410-4a60-90cf-0127e7e4157b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:41.029296 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-81782eb5-5410-4a60-90cf-0127e7e4157b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:41.036602 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-81782eb5-5410-4a60-90cf-0127e7e4157b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1239 microversion: 2.1 time: 0.069755 Jun 15 00:50:41.037159 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 457/951] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:40 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:42.053912 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:42.054528 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:42.061861 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:42.062316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:42.063076 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:42.063512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:42.123395 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:42.130834 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e2efebd6-9e2b-495a-819f-859ac6b79b90 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1235 microversion: 2.1 time: 0.081285 Jun 15 00:50:42.131396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 495/952] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:42 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:43.148121 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:43.148728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:43.155157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:43.155718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:43.156496 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:43.156940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:43.230443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:43.237892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e4091f8f-e5c2-4089-9d8c-95219d871a3b tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1297 microversion: 2.1 time: 0.093633 Jun 15 00:50:43.238457 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 458/953] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:43 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:44.254564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:44.255161 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:44.262525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:44.263022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:44.263783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:44.264294 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:44.478932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:44.486610 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-67882f6b-ccfb-44da-88ad-e2e8207191ee tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.235971 Jun 15 00:50:44.487186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 496/954] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:44 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:44.960058 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-645faa7c-1b6c-4ad8-a21e-f4b584dd2846 req-c9907f82-4d7b-4c41-9e1e-a1af0801f9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eca4147-6708-4aab-b156-44d5413e8d7e", "tag": "eb4e118a-a405-4371-86b3-31675c0599a5"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:44.971113 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-645faa7c-1b6c-4ad8-a21e-f4b584dd2846 req-c9907f82-4d7b-4c41-9e1e-a1af0801f9bc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:44.971113 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-645faa7c-1b6c-4ad8-a21e-f4b584dd2846 req-c9907f82-4d7b-4c41-9e1e-a1af0801f9bc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:44.985356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-645faa7c-1b6c-4ad8-a21e-f4b584dd2846 req-c9907f82-4d7b-4c41-9e1e-a1af0801f9bc service nova] Creating event network-changed:eb4e118a-a405-4371-86b3-31675c0599a5 for instance 5eca4147-6708-4aab-b156-44d5413e8d7e on hv-cinder-84517 Jun 15 00:50:44.990265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-645faa7c-1b6c-4ad8-a21e-f4b584dd2846 req-c9907f82-4d7b-4c41-9e1e-a1af0801f9bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039713 Jun 15 00:50:44.999945 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 459/955] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:45.503587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:45.504308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:45.523082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:45.523082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:45.523082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:45.523082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:45.701494 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:45.708946 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b1542912-dd42-4904-9375-08acfbf5e324 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.209244 Jun 15 00:50:45.709518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 497/956] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:45 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:46.725933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:46.726626 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:46.733108 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:46.733556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:46.734321 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:46.734761 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:46.862443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:46.869869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-199129e5-32c4-407c-9e74-77932f312451 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.148541 Jun 15 00:50:46.871060 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 460/957] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:46 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:47.887093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:47.887685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:47.894566 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:47.895015 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:47.895771 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:47.896227 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:48.021037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:48.028915 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-53e50bec-676d-48aa-9ad2-d33e91e38aa5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.146179 Jun 15 00:50:48.029473 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 498/958] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:47 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:48.961233 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e30c3c74-e9c6-479d-989f-b18a6102cace req-12d4e9e6-b036-45a4-b136-fed5c885cbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca4147-6708-4aab-b156-44d5413e8d7e", "name": "network-vif-plugged", "status": "completed", "tag": "eb4e118a-a405-4371-86b3-31675c0599a5"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:48.969529 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e30c3c74-e9c6-479d-989f-b18a6102cace req-12d4e9e6-b036-45a4-b136-fed5c885cbc8 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:48.969990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e30c3c74-e9c6-479d-989f-b18a6102cace req-12d4e9e6-b036-45a4-b136-fed5c885cbc8 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:48.980647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e30c3c74-e9c6-479d-989f-b18a6102cace req-12d4e9e6-b036-45a4-b136-fed5c885cbc8 service nova] Creating event network-vif-plugged:eb4e118a-a405-4371-86b3-31675c0599a5 for instance 5eca4147-6708-4aab-b156-44d5413e8d7e on hv-cinder-84517 Jun 15 00:50:48.985427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e30c3c74-e9c6-479d-989f-b18a6102cace req-12d4e9e6-b036-45a4-b136-fed5c885cbc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028157 Jun 15 00:50:48.989943 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 461/959] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:50:49.045844 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:49.046455 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:49.053096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:49.053554 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:49.054564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:49.055216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:49.192370 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:49.200442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-03287e89-4e34-4934-aa1c-d3d31f4cf6a6 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.158617 Jun 15 00:50:49.201022 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 499/960] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:49 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:50.218484 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:50.219199 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:50.225876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:50.226317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:50.227072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:50.227495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:50.357444 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:50.364990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9babbde7-3af2-48ae-8cbc-12f43e180e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1364 microversion: 2.1 time: 0.151332 Jun 15 00:50:50.365555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 462/961] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:50 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:51.382424 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:51.382963 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:51.385329 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.385977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.386609 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.391201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:51.391640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:51.392425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:51.393105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:51.519407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:50:51.527372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a3efa0a3-807f-436c-a0e2-564ff0b6cb05 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1554 microversion: 2.1 time: 0.148435 Jun 15 00:50:51.527952 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 500/962] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:50:51 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:50:51.544668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:50:51.545156 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:50:51.547054 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.548224 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.553088 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:51.553535 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:51.554291 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:51.554755 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:51.558428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:51.628773 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-6ced77e5-3822-46dc-95aa-2403cb975914 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087952 Jun 15 00:50:51.629360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 463/963] 10.222.0.17 () {58 vars in 1274 bytes} [Wed Jun 15 00:50:51 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:50:52.570013 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-19094efe-78b3-4d32-a30b-10d610e5ea82 req-155d70f7-cd6c-44cb-a124-47a06c884bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eca4147-6708-4aab-b156-44d5413e8d7e", "tag": "eb4e118a-a405-4371-86b3-31675c0599a5"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:50:52.579415 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-19094efe-78b3-4d32-a30b-10d610e5ea82 req-155d70f7-cd6c-44cb-a124-47a06c884bb6 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:50:52.579850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-19094efe-78b3-4d32-a30b-10d610e5ea82 req-155d70f7-cd6c-44cb-a124-47a06c884bb6 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:50:52.590938 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-19094efe-78b3-4d32-a30b-10d610e5ea82 req-155d70f7-cd6c-44cb-a124-47a06c884bb6 service nova] Creating event network-changed:eb4e118a-a405-4371-86b3-31675c0599a5 for instance 5eca4147-6708-4aab-b156-44d5413e8d7e on hv-cinder-84517 Jun 15 00:50:52.600398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-19094efe-78b3-4d32-a30b-10d610e5ea82 req-155d70f7-cd6c-44cb-a124-47a06c884bb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029928 Jun 15 00:50:52.600398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 501/964] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:28.324872 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:28.325492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:28.332553 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:28.332995 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:28.333740 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:28.334169 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:28.362949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e0ca1412-4fe6-4a57-befd-24c6a1b9cf9e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/ips" status: 200 len: 150 microversion: 2.1 time: 0.043539 Jun 15 00:51:28.363530 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 464/965] 10.222.0.17 () {58 vars in 1247 bytes} [Wed Jun 15 00:51:28 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:29.926416 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34e22cc2-798c-4a1c-ad68-a094069707fb"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:51:29.933924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:29.933924 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=82 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:29.935228 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:29.935661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:29.936434 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:29.936863 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:30.590239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e0d0a821-6698-4f96-a5f7-eb556134fa73 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "POST /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668015 Jun 15 00:51:30.590839 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 502/966] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:51:29 2022] POST /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:38.161632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:38.162146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:38.168726 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:38.169968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:38.170515 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:38.170944 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:38.249743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'services' on Instance uuid 5eca4147-6708-4aab-b156-44d5413e8d7e {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:51:38.442925 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f655379d-6422-488d-8ea5-04137739f485 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments/34e22cc2-798c-4a1c-ad68-a094069707fb" status: 202 len: 0 microversion: 2.1 time: 0.285682 Jun 15 00:51:38.443509 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 465/967] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:51:38 2022] DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments/34e22cc2-798c-4a1c-ad68-a094069707fb => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:51:38.453373 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:38.454466 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:38.461170 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:38.461625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:38.462390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:38.462823 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:38.492273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5b855585-d9be-43e6-a4b3-307e99f1febf tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Jun 15 00:51:38.492764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 503/968] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:51:38 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:39.510858 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:39.511928 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:39.518871 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:39.519349 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:39.520148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:39.520574 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:39.551415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cd046270-a840-47e9-9853-be9233e3d6bb tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Jun 15 00:51:39.551896 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 466/969] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:51:39 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:40.563259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:40.564224 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:40.570708 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:40.571153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:40.571943 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:40.572399 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:40.599536 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0b880049-cdf8-4dcb-b5d2-a95817773cdc tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040813 Jun 15 00:51:40.600106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 504/970] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:51:40 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:51:40.656966 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:40.657472 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:40.664094 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:40.664985 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:40.665740 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:40.666168 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:40.693908 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:51:41.014682 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-184137c3-f016-40ed-912f-c62af14a205d tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 204 len: 0 microversion: 2.1 time: 0.361088 Jun 15 00:51:41.015242 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 467/971] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:51:40 2022] DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:51:41.023604 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:41.024240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:41.030862 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:41.037322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:41.037322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:41.037322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:41.162100 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:51:41.170550 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-aa625be6-a3ba-4d70-8fac-568cddc8f5ce tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1679 microversion: 2.1 time: 0.150752 Jun 15 00:51:41.171105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 505/972] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:41 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:51:42.188900 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:42.189588 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:42.196021 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:42.196462 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:42.197207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:42.197975 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:42.329186 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:51:42.336875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-31b8db00-9bca-45b7-8f0b-4cd0bf8852a4 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1679 microversion: 2.1 time: 0.152820 Jun 15 00:51:42.340576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 468/973] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:42 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:51:43.354019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:43.354618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:43.361088 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:43.361529 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:43.362287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:43.362715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:43.523661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:51:43.532437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-42f8ba65-54e1-4b17-ae9f-768ec40371e5 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1679 microversion: 2.1 time: 0.182095 Jun 15 00:51:43.533186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 506/974] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:43 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:51:43.802352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-e02e1da0-b318-4465-957f-f697d4347eb8 req-9b71e455-5ec1-4524-9d48-1b8d42d1ce71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca4147-6708-4aab-b156-44d5413e8d7e", "name": "network-vif-deleted", "tag": "eb4e118a-a405-4371-86b3-31675c0599a5"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:51:43.811377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e02e1da0-b318-4465-957f-f697d4347eb8 req-9b71e455-5ec1-4524-9d48-1b8d42d1ce71 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:43.815063 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-e02e1da0-b318-4465-957f-f697d4347eb8 req-9b71e455-5ec1-4524-9d48-1b8d42d1ce71 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:43.822751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-e02e1da0-b318-4465-957f-f697d4347eb8 req-9b71e455-5ec1-4524-9d48-1b8d42d1ce71 service nova] Creating event network-vif-deleted:eb4e118a-a405-4371-86b3-31675c0599a5 for instance 5eca4147-6708-4aab-b156-44d5413e8d7e on hv-cinder-84517 Jun 15 00:51:43.827809 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-e02e1da0-b318-4465-957f-f697d4347eb8 req-9b71e455-5ec1-4524-9d48-1b8d42d1ce71 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029182 Jun 15 00:51:43.828592 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 469/975] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:51:44.550160 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:44.550984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:44.557644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:44.558089 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:44.558850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:44.559307 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:44.592745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:44.593200 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:44.593658 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lazy-loading 'fault' on Instance uuid 5eca4147-6708-4aab-b156-44d5413e8d7e {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:51:44.635427 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e857898104242699e7590b527c2631f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:51:44.644388 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b2044b98-2bf3-46d0-8388-5a2370b67e1a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 200 len: 1329 microversion: 2.1 time: 0.098395 Jun 15 00:51:44.644977 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 507/976] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:44 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 1329 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:51:45.662728 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:45.663425 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:45.670180 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:45.670625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:45.671377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:45.671808 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:45.685397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e HTTP/1.1 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:51:45.687056 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:45.688691 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '5eca4147-6708-4aab-b156-44d5413e8d7e'} Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:45.689600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:45.691135 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:45.692625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:45.692625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-06dc78b7-aaad-4260-90be-651d81869e24 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 404 len: 111 microversion: 2.1 time: 0.030000 Jun 15 00:51:45.692625 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 470/977] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:45 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:45.697039 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-73af0290-51d5-4e67-ad34-979c13b37142 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '.version_select at 0x7fa82404df70>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:45.879240 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-73af0290-51d5-4e67-ad34-979c13b37142 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257845557" status: 202 len: 0 microversion: 2.1 time: 0.185915 Jun 15 00:51:45.879845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 508/978] 10.222.0.17 () {58 vars in 1217 bytes} [Wed Jun 15 00:51:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257845557 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:51:47.832222 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:47.832699 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:47.839048 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:47.839527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:47.840309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:47.841304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:47.854450 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e HTTP/1.1 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:51:47.855990 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.858248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '5eca4147-6708-4aab-b156-44d5413e8d7e'} Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:47.859190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.860844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.862346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:47.862346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-141e5f69-36f8-4d8e-92b2-27ecf2ccb929 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 404 len: 111 microversion: 2.1 time: 0.029598 Jun 15 00:51:47.862346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 471/979] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:51:47 2022] DELETE /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:47.866603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:47.867204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 5eca4147-6708-4aab-b156-44d5413e8d7e] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:47.877742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:47.878187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:47.878944 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:47.879376 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:47.892321 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e HTTP/1.1 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:51:47.894202 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.895780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '5eca4147-6708-4aab-b156-44d5413e8d7e'} Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:47.896689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. Jun 15 00:51:47.898287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:47.899884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 5eca4147-6708-4aab-b156-44d5413e8d7e could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:47.899884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4de0a82d-c950-4bc4-95f1-e91cd452f8d7 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e" status: 404 len: 111 microversion: 2.1 time: 0.033216 Jun 15 00:51:47.899884 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 509/980] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:47 2022] GET /compute/v2.1/servers/5eca4147-6708-4aab-b156-44d5413e8d7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:49.209640 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:49.210119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:49.217201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.217649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.218430 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.218863 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.232570 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 HTTP/1.1 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:51:49.234085 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.235647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '0d61fee4-ff95-454f-8566-dbbef8ef7fa6'} Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:49.236428 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.237664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.238865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:49.238865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d613b1a1-bba9-420e-92fb-49c94882ae60 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 404 len: 111 microversion: 2.1 time: 0.029716 Jun 15 00:51:49.238865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 472/981] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:51:49 2022] DELETE /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:49.243638 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:49.244272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: 0d61fee4-ff95-454f-8566-dbbef8ef7fa6] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:49.250371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.250821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.251570 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.252030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.264998 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 HTTP/1.1 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:51:49.266525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.268071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '0d61fee4-ff95-454f-8566-dbbef8ef7fa6'} Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:49.269139 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. Jun 15 00:51:49.270316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.271376 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance 0d61fee4-ff95-454f-8566-dbbef8ef7fa6 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:49.271376 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2350f46c-ad04-4fb9-a52a-0d74104f3736 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6" status: 404 len: 111 microversion: 2.1 time: 0.028043 Jun 15 00:51:49.271376 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 510/982] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:49 2022] GET /compute/v2.1/servers/0d61fee4-ff95-454f-8566-dbbef8ef7fa6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:49.276346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:49.276835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:49.283190 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.283633 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.284415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.284846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.298282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c HTTP/1.1 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:51:49.299779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.301375 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': 'c9415985-9e06-4135-93bc-100cdb69e55c'} Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:49.302316 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.303758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.305230 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:49.305230 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9d3db298-f115-4e23-8683-dfd3f540a701 tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 404 len: 111 microversion: 2.1 time: 0.028663 Jun 15 00:51:49.305230 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 473/983] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:51:49 2022] DELETE /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:51:49.309194 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:49.309799 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: c9415985-9e06-4135-93bc-100cdb69e55c] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:49.315666 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.316159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.316905 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:49.317334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:49.330279 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c HTTP/1.1 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:51:49.331758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.333353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'c9415985-9e06-4135-93bc-100cdb69e55c'} Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:49.334277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. Jun 15 00:51:49.335735 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:49.337244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance c9415985-9e06-4135-93bc-100cdb69e55c could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:49.337244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9c0ecf82-f93f-4469-9269-d1e08fc20f0a tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c" status: 404 len: 111 microversion: 2.1 time: 0.027637 Jun 15 00:51:49.337244 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 511/984] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:49 2022] GET /compute/v2.1/servers/c9415985-9e06-4135-93bc-100cdb69e55c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 00:51:50.590860 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:50.591353 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:50.597892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:50.598335 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:50.599082 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:50.599511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:50.612988 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 HTTP/1.1 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:51:50.614523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.615933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': 'a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1'} Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:50.616672 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.618125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.619556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:50.619556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1de9f419-6acb-46f6-b6b6-f9dc2ef3f72e tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 404 len: 111 microversion: 2.1 time: 0.028796 Jun 15 00:51:50.619556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 474/985] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:51:50 2022] DELETE /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:51:50.625007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:51:50.625696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] [instance: a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:51:50.632296 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:50.634767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:50.634767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:51:50.634767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:51:50.647303 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] HTTP exception thrown: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Request method failure captured: Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 HTTP/1.1 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqSv5vZPCGLzFBmrY-HxkdTJwSPbsls_m0Vysp2qbhTzqKbIyi8wF_N9zkFFxPiGSc8-XeGyuCG1Gaw_RYtYKQ8jDQODq4F7O39bEWrTh0O7FzKeJsBx7rM4y0gux8IAU7c-oDdmkjWhFhfGobumn5_6011Nq-ApHKqct0lKGl4eZXwg Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:51:50.648829 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c73dcc78ab7c47abbb0dceebb5e212f2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c73dcc78ab7c47abbb0dceebb5e212f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c73dcc78ab7c47abbb0dceebb5e212f2"}]}] Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: c73dcc78ab7c47abbb0dceebb5e212f2 Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1474452250 Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 3e857898104242699e7590b527c2631f Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-AttachVolumeNegativeTest-1474452250-project Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.650475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': 'a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1'} Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:51:50.651371 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. Jun 15 00:51:50.653071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:51:50.654475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] Returning 404 to user: Instance a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:51:50.654475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-07d368b0-3aec-4bcd-96f0-fb8a4629fb9f tempest-AttachVolumeNegativeTest-1474452250 tempest-AttachVolumeNegativeTest-1474452250-project] 10.222.0.17 "GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1" status: 404 len: 111 microversion: 2.1 time: 0.029990 Jun 15 00:51:50.654475 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 512/986] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:51:50 2022] GET /compute/v2.1/servers/a145e5f2-882b-4b7d-8902-2cfc7a8a0cd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:52:16.886879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:52:16.887662 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 00:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:52:34.101837 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a93c0aa5-4dab-4dbd-b9fc-cdc186e77904 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'create', calling method: .version_select at 0x7fa8240258b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1587421045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImX7341w/bN1VxAKM2KUc9W0/qhi8znbnnkT/OEuzocLBz+Xypj0N2PZdGbcCeHYaEY5h0VWAGPLyjotwavMIVOnPffwdOuq665V9QFlkZ3IOQ2KNZtwG0iBtat/QEsfg=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:52:34.107185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:34.111184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:34.118856 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-a93c0aa5-4dab-4dbd-b9fc-cdc186e77904 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Getting quotas for project 26d2a26394184388ad17fd887c90c768. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:52:34.122726 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-a93c0aa5-4dab-4dbd-b9fc-cdc186e77904 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Getting quotas for user 66774a65beab4e6090994b261141eecc and project 26d2a26394184388ad17fd887c90c768. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:52:34.209775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a93c0aa5-4dab-4dbd-b9fc-cdc186e77904 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.111758 Jun 15 00:52:34.210326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 475/987] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:52:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:52:34.308204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-619733802", "imageRef": "04dfa15b-ec2d-41f1-bb2b-51da2de54eb0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1587421045", "networks": [{"uuid": "4fffa46c-8f70-4501-b0ea-5131b1ec18b0"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:52:34.315757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:34.323284 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:34.359980 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] validate_networks() for [('4fffa46c-8f70-4501-b0ea-5131b1ec18b0', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:52:35.060409 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:52:35.060826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:52:35.061287 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:52:35.061685 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:52:35.062081 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:52:35.070655 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:35.071090 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:35.071873 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:35.072332 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:35.088233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Getting quotas for project 26d2a26394184388ad17fd887c90c768. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:52:35.092063 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Getting quotas for user 66774a65beab4e6090994b261141eecc and project 26d2a26394184388ad17fd887c90c768. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:52:35.103332 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:52:35.105541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04dfa15b-ec2d-41f1-bb2b-51da2de54eb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:52:35.266216 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f6775b2d-9bef-4d58-9666-ca2e2ab59e59 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961453 Jun 15 00:52:35.266857 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 513/988] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:52:35.276927 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-91e5d3b5-d3de-4da8-84e8-2377a4a860d3 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:35.277526 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-91e5d3b5-d3de-4da8-84e8-2377a4a860d3 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:35.335396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-91e5d3b5-d3de-4da8-84e8-2377a4a860d3 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:35.342080 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-91e5d3b5-d3de-4da8-84e8-2377a4a860d3 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1258 microversion: 2.1 time: 0.069035 Jun 15 00:52:35.342641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 476/989] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:35 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:36.360347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:36.360920 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:36.367687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:36.372308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:36.372308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:36.372308 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:36.431523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:36.439142 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1c189f51-27ae-4abd-8954-ae4c1090e80d tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1262 microversion: 2.1 time: 0.083889 Jun 15 00:52:36.439942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 514/990] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:36 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:37.457511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:37.458307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:37.464638 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:37.465087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:37.465846 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:37.466295 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:37.526037 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:37.533495 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-686ac93f-9d97-4d0f-b71e-e9bd0e64d2e2 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1310 microversion: 2.1 time: 0.080919 Jun 15 00:52:37.534043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 477/991] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:37 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:38.551671 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:38.552444 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:38.559612 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:38.560186 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:38.561017 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:38.561513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:38.735254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:38.743085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8a370e9c-d730-482e-b55a-ca7369ff4f8c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.195837 Jun 15 00:52:38.746441 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 515/992] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:38 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:39.762740 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:39.763346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:39.774246 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:39.774698 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:39.775474 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:39.775924 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:39.914864 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:39.922360 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9aed812f-2127-446f-ac60-cc77b5fbb5f4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.163391 Jun 15 00:52:39.923355 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 478/993] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:39 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:40.940302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:40.941850 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:40.949198 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:40.949888 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:40.950657 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:40.951088 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:41.084951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:41.092318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-eea3e7f3-5a21-40e2-86aa-ce8fa8dcbff4 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.157191 Jun 15 00:52:41.092881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 516/994] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:40 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:42.110820 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:42.112265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:42.125617 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:42.126148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:42.127000 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:42.127504 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:42.267707 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:42.276096 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-33748e34-4ce1-4737-af25-35aeebfe06e9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.169819 Jun 15 00:52:42.288483 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 479/995] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:42 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:43.295070 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:43.295690 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:43.303295 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:43.303733 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:43.304513 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:43.304937 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:43.438867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:43.446259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fb0688a9-174e-4ce4-b53a-3b36f586f9f7 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.155044 Jun 15 00:52:43.446928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 517/996] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:43 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:44.463038 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:44.463585 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:44.471311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:44.472243 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:44.473127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:44.473562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:44.613877 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:44.621739 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c8e8e9b6-e6dd-4c31-bdd4-4ac7a72930c8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.162556 Jun 15 00:52:44.622309 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 480/997] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:44 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:45.641272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:45.641272 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:45.753960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:45.753960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:45.753960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:45.753960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:45.753960 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:45.756058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:45.805255 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:45.816847 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-2ee53ace-983d-4ef1-9f1e-cff59ad76c76 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.181387 Jun 15 00:52:45.817816 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 518/998] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:45 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:46.835444 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:46.836117 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:46.837960 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:46.858208 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:46.858870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:46.860044 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:46.860751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:47.087742 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:47.095292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-20eebc67-2fa2-40fa-8ac5-0d1be3becc8a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.264152 Jun 15 00:52:47.095857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 481/999] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:46 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:47.424608 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-4fa472bb-dfa1-40e1-8264-31f2b7581508 req-c823995f-c883-4097-92c2-142c8c41f9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:52:47.432535 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4fa472bb-dfa1-40e1-8264-31f2b7581508 req-c823995f-c883-4097-92c2-142c8c41f9cc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:47.433093 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-4fa472bb-dfa1-40e1-8264-31f2b7581508 req-c823995f-c883-4097-92c2-142c8c41f9cc service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:47.444357 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-4fa472bb-dfa1-40e1-8264-31f2b7581508 req-c823995f-c883-4097-92c2-142c8c41f9cc service nova] Creating event network-changed:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:52:47.449521 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-4fa472bb-dfa1-40e1-8264-31f2b7581508 req-c823995f-c883-4097-92c2-142c8c41f9cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210676 Jun 15 00:52:47.450087 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 519/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:52:48.112401 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:48.113026 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:48.119492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:48.120111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:48.120756 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:48.121188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:48.318147 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:48.327273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7264c2a3-75ae-4b8d-9904-38ad5378fa1f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.218765 Jun 15 00:52:48.336865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 482/1001] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:48 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:49.345900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:49.346582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:49.353255 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:49.353696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:49.354445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:49.354876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:49.483031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:49.490716 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-142e9a5e-932f-48bd-9597-22d0628a32a8 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.149479 Jun 15 00:52:49.493282 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 520/1002] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:49 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:50.507123 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:50.507723 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:50.514234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:50.514683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:50.515427 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:50.515854 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:50.643195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:50.650669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2aa6d62a-f92a-47b2-9e9f-c024a4773b58 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.147429 Jun 15 00:52:50.651250 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 483/1003] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:50 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:51.667859 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:51.668538 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:51.675340 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:51.675781 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:51.676587 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:51.677014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:51.720128 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-b187ebb0-4678-4555-a394-c72788db3bd3 req-f7ab3dc5-b3cb-49e4-a4c8-ba453a6dc18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "name": "network-vif-plugged", "status": "completed", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:52:51.728541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b187ebb0-4678-4555-a394-c72788db3bd3 req-f7ab3dc5-b3cb-49e4-a4c8-ba453a6dc18c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:51.728984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-b187ebb0-4678-4555-a394-c72788db3bd3 req-f7ab3dc5-b3cb-49e4-a4c8-ba453a6dc18c service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:51.745666 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-b187ebb0-4678-4555-a394-c72788db3bd3 req-f7ab3dc5-b3cb-49e4-a4c8-ba453a6dc18c service nova] Creating event network-vif-plugged:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:52:51.752120 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-b187ebb0-4678-4555-a394-c72788db3bd3 req-f7ab3dc5-b3cb-49e4-a4c8-ba453a6dc18c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125312 Jun 15 00:52:51.752901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 521/1004] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:52:51.810578 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:51.818867 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-598a05e2-7345-46d3-a6f4-28d9ec475c1e tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.154777 Jun 15 00:52:51.819746 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 484/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:51 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:52:52.836349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:52.837030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:52.843564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:52.844037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:52.844831 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:52.845259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:52.969353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:52.976625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c1d98bce-1c36-4b7c-8689-c1cc38aac7fe tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1358 microversion: 2.1 time: 0.144560 Jun 15 00:52:52.977178 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 522/1006] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:52 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:53.992963 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:53.993523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:53.999843 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.000315 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.001072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.001488 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.124225 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:54.131729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e9a6739c-0e6a-4ecb-878e-99575ef85aff tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1548 microversion: 2.1 time: 0.142704 Jun 15 00:52:54.132337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 485/1007] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:53 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1548 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:54.148666 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:54.149262 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:54.155969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.156407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.157788 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.158214 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.287824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:54.295163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1afc1f25-dc16-478a-b9c9-a862bf25e475 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1548 microversion: 2.1 time: 0.150644 Jun 15 00:52:54.295715 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 523/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:54 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:54.310708 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:54.314668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:54.315493 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Searching by: {'deleted': False, 'project_id': '26d2a26394184388ad17fd887c90c768'} {{(pid=124682) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 00:52:54.322023 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.322491 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.323279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.323711 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.413624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.multi_cell_list [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 00:52:54.503810 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e40fe6e9-8843-4025-bdda-30271814d9eb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196859 Jun 15 00:52:54.504410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 486/1009] 10.222.0.17 () {58 vars in 1124 bytes} [Wed Jun 15 00:52:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:52:54.514660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:52:54.515261 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:54.522094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.522538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.523292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:54.523720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:54.650728 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:52:54.658102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8919dce8-8b73-4ce9-8957-433c67095f9f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1548 microversion: 2.1 time: 0.147318 Jun 15 00:52:54.658662 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 524/1010] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:52:54 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:52:56.544758 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "630b4521-4076-4051-b76c-99bb50473286"}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:52:56.545847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:52:56.552317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:56.552767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:56.553545 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:52:56.553984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:52:57.121065 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f56e12d3-c301-40ce-9f5c-58a9cfe0aace tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580090 Jun 15 00:52:57.121681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 487/1011] 10.222.0.17 () {60 vars in 1322 bytes} [Wed Jun 15 00:52:56 2022] POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:53:04.644293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:04.644900 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:04.647691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:04.652387 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:04.652826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:04.653575 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:04.654004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:04.654438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=60 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:04.783661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:04.791665 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-14b2606f-4f01-41fa-b664-33c4e4aa685a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1594 microversion: 2.1 time: 0.152107 Jun 15 00:53:04.792254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 525/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:04 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:06.883372 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:06.884276 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:06.941731 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-efc79552-92bd-4c60-9df3-05234fc97238 req-4df43035-0eee-4df9-ad12-895bfe0d097a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:53:06.949961 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-efc79552-92bd-4c60-9df3-05234fc97238 req-4df43035-0eee-4df9-ad12-895bfe0d097a service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:06.950405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-efc79552-92bd-4c60-9df3-05234fc97238 req-4df43035-0eee-4df9-ad12-895bfe0d097a service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:06.961354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-efc79552-92bd-4c60-9df3-05234fc97238 req-4df43035-0eee-4df9-ad12-895bfe0d097a service nova] Creating event network-changed:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:53:06.966805 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-efc79552-92bd-4c60-9df3-05234fc97238 req-4df43035-0eee-4df9-ad12-895bfe0d097a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092775 Jun 15 00:53:06.967416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 488/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:53:09.075117 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-776071998"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:53:09.075652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:09.082588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:09.083031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:09.083779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:09.084246 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:09.204327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.network.security_group_api [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Adding security group a1b13613-fa13-4f38-a733-f41a33021af3 to port 9e7aba3a-06d9-41a8-8ffb-dc818a60019a Jun 15 00:53:09.568233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-53ce3289-d014-451a-acaf-b57290ee4d60 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action" status: 202 len: 0 microversion: 2.1 time: 0.496872 Jun 15 00:53:09.568840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 526/1014] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:53:09 2022] POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:53:09.579956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-dc576d25-32f8-40dd-9a0d-15a136d17d52 req-35cf584c-db95-47e8-b03c-bd2ffde074b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:53:09.583761 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:09.585266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:09.592091 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-dc576d25-32f8-40dd-9a0d-15a136d17d52 req-35cf584c-db95-47e8-b03c-bd2ffde074b9 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:09.592726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-dc576d25-32f8-40dd-9a0d-15a136d17d52 req-35cf584c-db95-47e8-b03c-bd2ffde074b9 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:09.601193 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:09.601636 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:09.602405 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:09.603063 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:09.608832 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:09.614259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-dc576d25-32f8-40dd-9a0d-15a136d17d52 req-35cf584c-db95-47e8-b03c-bd2ffde074b9 service nova] Creating event network-changed:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:53:09.619854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-dc576d25-32f8-40dd-9a0d-15a136d17d52 req-35cf584c-db95-47e8-b03c-bd2ffde074b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044901 Jun 15 00:53:09.621717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 527/1015] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:53:09.862763 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:09.870690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-de2a0800-ac26-465c-b998-a25e146014c1 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1759 microversion: 2.1 time: 0.297148 Jun 15 00:53:09.871280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 489/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:09 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1759 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:32.560908 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:32.562158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=12 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:32.566254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:53:32.567302 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:32.573354 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:32.573821 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:32.574574 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:32.575001 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:32.776111 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ec03a25d-d9b2-4c9a-a249-5e3f235d5f62 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action" status: 202 len: 0 microversion: 2.1 time: 0.216441 Jun 15 00:53:32.776744 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 528/1017] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:53:32 2022] POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:53:32.785754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:32.786357 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:32.788827 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:32.789489 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=5 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:32.795470 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:32.795941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:32.797265 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:32.797742 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:33.030403 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:33.038460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-96de9b37-b3e1-4cab-865c-bd036e35a533 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1751 microversion: 2.1 time: 0.257526 Jun 15 00:53:33.039022 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 490/1018] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:32 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:34.058098 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:34.058791 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:34.064986 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:34.065429 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:34.066187 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:34.066615 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:34.282107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:34.290133 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b17a2c5b-6438-44c5-a0d2-2fff97ca0909 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1751 microversion: 2.1 time: 0.236695 Jun 15 00:53:34.290863 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 529/1019] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:34 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1751 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:35.308184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:35.308788 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:35.315387 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:35.315835 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:35.316616 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:35.317045 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:35.452919 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:35.460915 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-4fdece8f-b4cd-4626-a001-8325cc3c347c tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.156610 Jun 15 00:53:35.461479 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 491/1020] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:35 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:36.478085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:36.478667 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:36.485130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:36.485576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:36.486348 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:36.486780 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:36.627425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:36.635401 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-90673a80-bd41-4cc5-b6ce-5dee9eb99356 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.161233 Jun 15 00:53:36.635990 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 530/1021] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:36 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:37.652700 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:37.653238 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:37.659605 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:37.660086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:37.667238 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:37.667238 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:37.799214 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:37.807461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-f8a1c495-1cb5-47e6-bfd1-ce3c5a674150 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.158660 Jun 15 00:53:37.808049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 492/1022] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:37 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:38.824649 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:38.825250 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:38.832601 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:38.833043 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:38.833852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:38.834277 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:38.976921 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:38.984815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-500b04bd-c404-4d32-968c-81bc93208820 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.164071 Jun 15 00:53:38.985381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 531/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:38 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:40.002847 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:40.003382 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:40.009795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:40.010234 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:40.010971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:40.011393 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:40.146885 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:40.154742 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ccbf5d10-3dde-4f01-b53c-73ebcce15b7a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.156314 Jun 15 00:53:40.155294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 493/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:39 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:41.171580 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:41.172217 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:41.178311 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:41.178754 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:41.179501 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:41.179955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:41.316218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:41.324030 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ecb59916-4659-4013-9c3d-2fe7b819a38a tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.156229 Jun 15 00:53:41.324582 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 532/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:41 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:42.342028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:42.342669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:42.349207 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:42.354592 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:42.354592 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:42.354592 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:42.492643 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:42.500596 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c9106206-f4a7-4b48-95a5-767916d113bc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.162642 Jun 15 00:53:42.501156 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 494/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:42 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:53:43.518492 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:43.519094 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:43.525777 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:43.526211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:43.526951 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:43.527374 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:43.664034 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:43.671824 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7b3f14d0-cd4a-4cda-8bae-89ebe42a0ddc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.157572 Jun 15 00:53:43.672405 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 533/1027] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:43 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:44.688965 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:44.689576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:44.696645 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:44.697093 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:44.697876 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:44.698308 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:44.840518 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:44.848317 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b5f26cf1-7ba4-4488-b09d-57af92714876 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.163209 Jun 15 00:53:44.848875 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 495/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:44 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:45.865797 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:45.866392 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:45.872816 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:45.873254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:45.873999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:45.874421 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:46.012559 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:46.020596 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9a551ad4-cded-4f61-8dad-ea64684fc9da tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.159114 Jun 15 00:53:46.021151 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 534/1029] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:45 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:47.038150 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:47.038766 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:47.045204 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:47.045656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:47.046417 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:47.046857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:47.187887 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:47.195830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-76c19806-34a8-44e3-9cdc-5edcdb04b5cb tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.162044 Jun 15 00:53:47.197901 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 496/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:47 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:48.213925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:48.214534 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:48.220899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:48.221837 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:48.222581 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:48.223005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:48.360506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:48.368965 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b131a22d-5a6d-4c39-9a9a-70df075bfdda tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.158991 Jun 15 00:53:48.369514 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 535/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:48 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:49.385863 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:49.386449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:49.392909 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:49.393356 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:49.394111 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:49.394795 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:49.530282 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:49.540641 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ff49f876-ab68-4e65-b118-41941d672773 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.158609 Jun 15 00:53:49.541209 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 497/1032] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:49 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:50.558285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:50.558889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:50.565367 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:50.566314 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:50.567063 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:50.567491 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:50.708476 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:50.716625 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-9e1eb608-e621-424c-a1e4-a012731caa3f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1756 microversion: 2.1 time: 0.162231 Jun 15 00:53:50.717201 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 536/1033] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:50 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:53:51.733894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:53:51.734624 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:53:51.741064 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:51.741505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:51.742256 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:53:51.742683 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:53:51.879862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:53:51.887719 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2d1074fd-bdc0-4ded-aa70-ef8a9e555d73 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1759 microversion: 2.1 time: 0.157718 Jun 15 00:53:51.888318 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 498/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:53:51 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1759 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:54:24.648097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-776071998"}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:54:24.648725 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:24.650747 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=18 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:24.651390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:24.656085 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:24.656525 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:24.657273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:24.657703 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:24.786518 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.network.security_group_api [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Removing security group a1b13613-fa13-4f38-a733-f41a33021af3 from port 9e7aba3a-06d9-41a8-8ffb-dc818a60019a Jun 15 00:54:25.165577 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-cd05fa03-b790-44bc-8a05-014700a49ae9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action" status: 202 len: 0 microversion: 2.1 time: 0.521725 Jun 15 00:54:25.166647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 537/1035] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Jun 15 00:54:24 2022] POST /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:54:25.175802 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-9a9239e6-cafc-49b1-8795-910410a38a59 req-ec891242-997a-4c34-b3bb-e5b750844c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:54:25.180090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=18 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:25.180807 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=54 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:25.189092 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-9a9239e6-cafc-49b1-8795-910410a38a59 req-ec891242-997a-4c34-b3bb-e5b750844c2d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:25.190602 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-9a9239e6-cafc-49b1-8795-910410a38a59 req-ec891242-997a-4c34-b3bb-e5b750844c2d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:25.205337 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-9a9239e6-cafc-49b1-8795-910410a38a59 req-ec891242-997a-4c34-b3bb-e5b750844c2d service nova] Creating event network-changed:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:54:25.211126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-9a9239e6-cafc-49b1-8795-910410a38a59 req-ec891242-997a-4c34-b3bb-e5b750844c2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041195 Jun 15 00:54:25.212458 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 499/1036] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:54:26.329999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:26.330686 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:26.332258 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-b71a8ccc-3da8-46b0-a567-fe3d4c051ef0 req-ba279ca4-615a-481a-a8a9-3c5a7e099d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:54:26.337522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:26.338292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:26.339260 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:26.339781 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:26.342239 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b71a8ccc-3da8-46b0-a567-fe3d4c051ef0 req-ba279ca4-615a-481a-a8a9-3c5a7e099d8d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:26.342709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-b71a8ccc-3da8-46b0-a567-fe3d4c051ef0 req-ba279ca4-615a-481a-a8a9-3c5a7e099d8d service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:26.353747 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-b71a8ccc-3da8-46b0-a567-fe3d4c051ef0 req-ba279ca4-615a-481a-a8a9-3c5a7e099d8d service nova] Creating event network-changed:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:54:26.358562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-b71a8ccc-3da8-46b0-a567-fe3d4c051ef0 req-ba279ca4-615a-481a-a8a9-3c5a7e099d8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030969 Jun 15 00:54:26.359378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 500/1037] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:54:26.436343 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lazy-loading 'services' on Instance uuid 9c3eb471-978f-4b18-aea1-828a23ffd40b {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:54:26.709745 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ee088a86-be3d-4507-85c4-1b121aba1f2b tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments/630b4521-4076-4051-b76c-99bb50473286" status: 202 len: 0 microversion: 2.1 time: 0.384173 Jun 15 00:54:26.710196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 538/1038] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:54:26 2022] DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments/630b4521-4076-4051-b76c-99bb50473286 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:54:26.719034 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:26.720146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:26.726825 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:26.727348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:26.728209 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:26.728717 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:26.759394 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-21d43393-34ba-4e5f-81d0-543b4d1fbdaf tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Jun 15 00:54:26.759965 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 501/1039] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:54:26 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:54:27.771969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:27.773019 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:27.779131 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:27.779577 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:27.780425 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:27.780854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:27.808848 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1167caf3-f585-463d-8004-68938aaa3207 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041901 Jun 15 00:54:27.809385 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 539/1040] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:54:27 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:54:28.821097 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:28.822043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:28.828387 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:28.828833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:28.829579 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:28.830661 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:28.857354 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-12a94f88-d6dc-45e7-9428-7ddead36c494 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040243 Jun 15 00:54:28.857894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 502/1041] 10.222.0.17 () {58 vars in 1301 bytes} [Wed Jun 15 00:54:28 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 00:54:28.867592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:28.868180 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:28.874531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:28.874979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:28.875727 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:28.876190 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:28.948890 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] HTTP exception thrown: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b is not attached to volume 630b4521-4076-4051-b76c-99bb50473286 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Request method failure captured: Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments/630b4521-4076-4051-b76c-99bb50473286 HTTP/1.1 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqS1BzWSl9A2k3F-sHZzuBQ3MZDxgoEJmLCqxNPC2wkwSDH9RfhJeQZY1wd2Ux9RBhbTBVdwe3sVJHW1_K7S8l3AGQR0iY8B_BvxUA-6MsmYjPDrfkisKojw77XbuShlHCuGu80NPTkJ7w0vV97KrUqhtTPTt6qVMtkFkfXVUrbEDm1U Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 26d2a26394184388ad17fd887c90c768 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:54:28.951233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_26d2a26394184388ad17fd887c90c768", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/26d2a26394184388ad17fd887c90c768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/26d2a26394184388ad17fd887c90c768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/26d2a26394184388ad17fd887c90c768"}]}] Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 26d2a26394184388ad17fd887c90c768 Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-TestMinimumBasicScenario-1107253755-project Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 66774a65beab4e6090994b261141eecc Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestMinimumBasicScenario-1107253755-project Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:54:28.952975 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b is not attached to volume 630b4521-4076-4051-b76c-99bb50473286 Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'server_id': '9c3eb471-978f-4b18-aea1-828a23ffd40b', 'id': '630b4521-4076-4051-b76c-99bb50473286'} Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 630b4521-4076-4051-b76c-99bb50473286. Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:54:28.953901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b is not attached to volume 630b4521-4076-4051-b76c-99bb50473286 Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b is not attached to volume 630b4521-4076-4051-b76c-99bb50473286 Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:54:28.956007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Returning 404 to user: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b is not attached to volume 630b4521-4076-4051-b76c-99bb50473286 {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:54:28.957226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-182b361c-b3eb-4998-be9d-b692bb76f397 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments/630b4521-4076-4051-b76c-99bb50473286" status: 404 len: 154 microversion: 2.1 time: 0.088995 Jun 15 00:54:28.957226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 540/1042] 10.222.0.17 () {58 vars in 1415 bytes} [Wed Jun 15 00:54:28 2022] DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b/os-volume_attachments/630b4521-4076-4051-b76c-99bb50473286 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:54:30.228084 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:30.228566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:30.235045 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:30.235487 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:30.236311 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:30.236733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:30.260584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:54:30.509823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-08cbeae6-b333-41bc-8a2a-e28951874441 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 204 len: 0 microversion: 2.1 time: 0.285260 Jun 15 00:54:30.510395 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 503/1043] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:54:30 2022] DELETE /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:54:30.519442 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:30.520488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:30.527697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:30.528167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:30.528979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:30.529401 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:30.658386 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:54:30.666007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c0c18bbd-611d-44bb-864e-bf985650492f tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1554 microversion: 2.1 time: 0.151203 Jun 15 00:54:30.666565 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 541/1044] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:54:30 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:54:31.683666 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:31.684401 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:31.691329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:31.691780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:31.692611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:31.693049 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:31.818158 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:54:31.825571 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2e2d0ef1-afe7-4751-b26f-f168e9eb1981 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1554 microversion: 2.1 time: 0.146105 Jun 15 00:54:31.826136 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 504/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:54:31 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:54:32.843052 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:32.843796 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:32.850946 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:32.851446 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:32.852304 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:32.852739 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:33.048684 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:54:33.056251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2e58f5f-1a9d-4f32-b3a2-b416e07129a9 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1554 microversion: 2.1 time: 0.217020 Jun 15 00:54:33.058278 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 542/1046] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:54:32 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:54:33.283003 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-86c24753-eac7-45e2-a5b5-3d23edaa4df0 req-6e0108c2-238e-4e30-86c6-e6b46e726933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb471-978f-4b18-aea1-828a23ffd40b", "name": "network-vif-deleted", "tag": "9e7aba3a-06d9-41a8-8ffb-dc818a60019a"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:54:33.291829 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-86c24753-eac7-45e2-a5b5-3d23edaa4df0 req-6e0108c2-238e-4e30-86c6-e6b46e726933 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:33.292363 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-86c24753-eac7-45e2-a5b5-3d23edaa4df0 req-6e0108c2-238e-4e30-86c6-e6b46e726933 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:33.303124 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-86c24753-eac7-45e2-a5b5-3d23edaa4df0 req-6e0108c2-238e-4e30-86c6-e6b46e726933 service nova] Creating event network-vif-deleted:9e7aba3a-06d9-41a8-8ffb-dc818a60019a for instance 9c3eb471-978f-4b18-aea1-828a23ffd40b on hv-cinder-84517 Jun 15 00:54:33.307797 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-86c24753-eac7-45e2-a5b5-3d23edaa4df0 req-6e0108c2-238e-4e30-86c6-e6b46e726933 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028482 Jun 15 00:54:33.308440 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 505/1047] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:54:34.073099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:34.073700 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:34.080130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:34.080579 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:34.081333 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:34.081769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:34.111893 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:34.112365 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:34.112802 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lazy-loading 'fault' on Instance uuid 9c3eb471-978f-4b18-aea1-828a23ffd40b {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 00:54:34.155215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66774a65beab4e6090994b261141eecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d2a26394184388ad17fd887c90c768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:54:34.162972 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f25ff811-3eb4-48ed-980a-764e33b408cc tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 200 len: 1348 microversion: 2.1 time: 0.093709 Jun 15 00:54:34.163522 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 543/1048] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:54:34 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:54:35.183304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:35.184053 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] [instance: 9c3eb471-978f-4b18-aea1-828a23ffd40b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:54:35.191277 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:35.191721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:35.192511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:54:35.192937 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:54:35.206171 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] HTTP exception thrown: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Request method failure captured: Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b HTTP/1.1 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqS1BzWSl9A2k3F-sHZzuBQ3MZDxgoEJmLCqxNPC2wkwSDH9RfhJeQZY1wd2Ux9RBhbTBVdwe3sVJHW1_K7S8l3AGQR0iY8B_BvxUA-6MsmYjPDrfkisKojw77XbuShlHCuGu80NPTkJ7w0vV97KrUqhtTPTt6qVMtkFkfXVUrbEDm1U Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 26d2a26394184388ad17fd887c90c768 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 00:54:35.207850 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_26d2a26394184388ad17fd887c90c768", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/26d2a26394184388ad17fd887c90c768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/26d2a26394184388ad17fd887c90c768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/26d2a26394184388ad17fd887c90c768"}]}] Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 26d2a26394184388ad17fd887c90c768 Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1107253755 Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-TestMinimumBasicScenario-1107253755-project Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 66774a65beab4e6090994b261141eecc Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestMinimumBasicScenario-1107253755-project Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. Jun 15 00:54:35.209461 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '9c3eb471-978f-4b18-aea1-828a23ffd40b'} Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:54:35.210293 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. Jun 15 00:54:35.211555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 00:54:35.212779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Returning 404 to user: Instance 9c3eb471-978f-4b18-aea1-828a23ffd40b could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:54:35.212779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-7597e02b-5549-40ae-98ca-10fa94043e54 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b" status: 404 len: 111 microversion: 2.1 time: 0.030327 Jun 15 00:54:35.212779 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 506/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:54:35 2022] GET /compute/v2.1/servers/9c3eb471-978f-4b18-aea1-828a23ffd40b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:54:35.217855 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-39328202-885d-4199-b05a-98e2e372f738 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] Calling method '.version_select at 0x7fa8240280d0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:54:35.328183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-39328202-885d-4199-b05a-98e2e372f738 tempest-TestMinimumBasicScenario-1107253755 tempest-TestMinimumBasicScenario-1107253755-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1587421045" status: 202 len: 0 microversion: 2.1 time: 0.113983 Jun 15 00:54:35.328753 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 544/1050] 10.222.0.17 () {58 vars in 1271 bytes} [Wed Jun 15 00:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1587421045 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 00:54:56.910307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:56.910307 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:57.118998 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-bacf6644-a2f7-4b43-b728-cd99a4536ab2 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Action: 'create', calling method: .version_select at 0x7fa81f7784c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-89424052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXF482bYXmOhcvzseCHNR9pVdq4nDT3SUgFtwWmDIs28Gjznw+/n3nviYUWHdkpkbz1OwTXFKiwbWOqblu1bg+oTeNslV0Bs9QiDdTE9SIhar2PYwdpxlLWwH5xyFlnpQ=="}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:54:57.133251 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bacf6644-a2f7-4b43-b728-cd99a4536ab2 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:54:57.137454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-bacf6644-a2f7-4b43-b728-cd99a4536ab2 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for user 272ca1a24cb4415db3abe93e7964b61c and project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'key_pairs'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:54:57.237966 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-bacf6644-a2f7-4b43-b728-cd99a4536ab2 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.336585 Jun 15 00:54:57.238576 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 507/1051] 10.222.0.17 () {60 vars in 1158 bytes} [Wed Jun 15 00:54:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:55:16.160929 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:55:16.161417 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 00:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:55:17.363253 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-628355370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89424052", "security_groups": [{"name": "tempest-secgroup-smoke-1366480916"}], "block_device_mapping_v2": [{"uuid": "a85b28a8-75e6-4809-9f82-24b54335156e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc9677-49b8-4ed8-803a-d2e653f7209d"}]}} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:55:17.372031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:17.372782 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:17.477158 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.network.neutron [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] validate_networks() for [('3bdc9677-49b8-4ed8-803a-d2e653f7209d', None, None, None, None, None)] {{(pid=124683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:55:17.832058 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:55:17.832512 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image limits 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:55:17.833042 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:55:17.833445 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image pref 0:0:0 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:55:17.833856 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.virt.hardware [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:55:17.842618 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:17.843066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:17.843858 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:17.844318 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:17.861148 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:55:17.865051 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.quota [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for user 272ca1a24cb4415db3abe93e7964b61c and project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:55:17.921341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Going to run 1 instances... {{(pid=124683) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:55:17.923491 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a85b28a8-75e6-4809-9f82-24b54335156e',volume_size=None,volume_type=None)] {{(pid=124683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:55:18.321548 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e713ed42-5c2c-4d6b-985f-e815855e4374 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.962690 Jun 15 00:55:18.322189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 545/1052] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:55:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:55:18.330176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=4 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:18.330939 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:18.334707 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-132dd196-8444-48c4-9aa0-ec4339fe2287 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:18.335348 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-132dd196-8444-48c4-9aa0-ec4339fe2287 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:18.388649 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-132dd196-8444-48c4-9aa0-ec4339fe2287 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:18.396126 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-132dd196-8444-48c4-9aa0-ec4339fe2287 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1092 microversion: 2.1 time: 0.067865 Jun 15 00:55:18.396678 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 508/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:18 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:19.414243 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:19.414930 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:19.421474 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:19.421925 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:19.422691 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:19.423177 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:19.484495 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:19.491979 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-483dc1af-9d87-44bc-be9c-54fda7d12006 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1142 microversion: 2.1 time: 0.082220 Jun 15 00:55:19.492539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 546/1054] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:19 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1142 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:20.510648 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:20.511249 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:20.517865 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:20.518355 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:20.519103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:20.519532 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:20.730656 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:20.739889 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ce9552a2-0f88-49d4-8dd2-9f8cb66de3d9 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1198 microversion: 2.1 time: 0.232924 Jun 15 00:55:20.740212 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 509/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:20 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1198 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:21.756720 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:21.759578 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:21.763973 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:21.764418 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:21.765167 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:21.765587 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:21.946004 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:21.954334 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-45be043d-9fe6-4632-a378-0f33af40cf1e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1276 microversion: 2.1 time: 0.201338 Jun 15 00:55:21.954911 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 547/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:21 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:55:22.200415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-f5760f76-a54e-4359-ac6a-32c62efd1fd3 req-c16f5c8e-b333-44fd-95f5-5f18307104e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e3a164-15bb-4b51-996d-b66ddf8f354b", "tag": "933a7e51-7923-4837-b690-69464641d2bd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:55:22.210489 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f5760f76-a54e-4359-ac6a-32c62efd1fd3 req-c16f5c8e-b333-44fd-95f5-5f18307104e2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:22.210926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-f5760f76-a54e-4359-ac6a-32c62efd1fd3 req-c16f5c8e-b333-44fd-95f5-5f18307104e2 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:22.224172 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-f5760f76-a54e-4359-ac6a-32c62efd1fd3 req-c16f5c8e-b333-44fd-95f5-5f18307104e2 service nova] Creating event network-changed:933a7e51-7923-4837-b690-69464641d2bd for instance 00e3a164-15bb-4b51-996d-b66ddf8f354b on hv-cinder-84517 Jun 15 00:55:22.229527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-f5760f76-a54e-4359-ac6a-32c62efd1fd3 req-c16f5c8e-b333-44fd-95f5-5f18307104e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033951 Jun 15 00:55:22.230166 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 510/1057] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:55:22.970617 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:22.971265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:22.977740 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:22.978195 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:22.979118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:22.979555 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:23.127488 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:23.135048 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-b4972084-71f3-4d35-bdfe-b82d042a7969 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.168362 Jun 15 00:55:23.143406 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 548/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:22 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:24.152621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:24.153318 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:24.159918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:24.160381 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:24.161130 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:24.161562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:24.287201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:24.294555 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2b1071fe-d87a-4ad0-83be-c1c63504e721 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.146226 Jun 15 00:55:24.295112 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 511/1059] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:24 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:25.311322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:25.311955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:25.318549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:25.319007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:25.319770 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:25.320258 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:25.448273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:25.456265 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-19124528-bf08-4ab7-b017-460ef2b51765 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.148844 Jun 15 00:55:25.456843 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 549/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:25 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:26.473587 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:26.474129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:26.480559 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:26.481007 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:26.481757 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:26.482188 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:26.607767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:26.615699 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-97028ad3-40a2-4aa1-b24a-c111ea76a707 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.146676 Jun 15 00:55:26.616292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 512/1061] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:26 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:27.633498 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:27.634102 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:27.640817 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:27.641341 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:27.642134 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:27.642556 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:27.770585 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:27.778090 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-6a6fa272-6fcc-434f-ae0c-02d229b076fc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.149585 Jun 15 00:55:27.778652 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 550/1062] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:27 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:28.794659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:28.795261 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:28.797710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:28.802502 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:28.802940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:28.803681 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:28.804134 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:28.932937 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:28.940751 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-b0020a20-558a-48f5-956f-99204928225f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.149961 Jun 15 00:55:28.941310 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 513/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:28 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:29.957653 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:29.958258 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:29.960155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:29.960955 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=6 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:29.966096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:29.971071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:29.971071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:29.971071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:30.142005 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:30.150086 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-002c2093-b2a4-4f7d-8cf1-4c6a984f0b33 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.196749 Jun 15 00:55:30.150650 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 551/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:29 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:31.166744 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:31.167345 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:31.174704 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:31.175215 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:31.175980 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:31.176499 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:31.308771 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:31.316267 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5cdc9080-7607-4ae3-b290-2e8e80947b46 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.153369 Jun 15 00:55:31.316830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 514/1065] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:31 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:32.332818 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:32.337992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:32.340074 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:32.340541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:32.341285 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:32.341717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:32.470845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:32.478266 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-94defd0a-20e4-4bb5-a701-9d8d4c2de43e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.149349 Jun 15 00:55:32.478825 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 552/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:32 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:33.494454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:33.495068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:33.501997 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:33.502438 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:33.503184 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:33.503611 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:33.634490 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:33.641844 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3a5dda9b-b591-4a66-b96c-e89e72ed855e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.151223 Jun 15 00:55:33.642397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 515/1067] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:33 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:34.271814 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-fd756986-cb1e-4f21-b57b-db89513b2ad4 req-6b75c49c-a60d-4033-8438-8444f4a38f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e3a164-15bb-4b51-996d-b66ddf8f354b", "name": "network-vif-plugged", "status": "completed", "tag": "933a7e51-7923-4837-b690-69464641d2bd"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:55:34.280398 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-fd756986-cb1e-4f21-b57b-db89513b2ad4 req-6b75c49c-a60d-4033-8438-8444f4a38f75 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:34.280838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-fd756986-cb1e-4f21-b57b-db89513b2ad4 req-6b75c49c-a60d-4033-8438-8444f4a38f75 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:34.292125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-fd756986-cb1e-4f21-b57b-db89513b2ad4 req-6b75c49c-a60d-4033-8438-8444f4a38f75 service nova] Creating event network-vif-plugged:933a7e51-7923-4837-b690-69464641d2bd for instance 00e3a164-15bb-4b51-996d-b66ddf8f354b on hv-cinder-84517 Jun 15 00:55:34.297106 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-fd756986-cb1e-4f21-b57b-db89513b2ad4 req-6b75c49c-a60d-4033-8438-8444f4a38f75 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029174 Jun 15 00:55:34.297677 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 553/1068] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:55:34.658632 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:34.659186 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:34.665562 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:34.666005 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:34.666749 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:34.667173 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:34.843008 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:34.850287 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8fce8845-ea0d-4841-9417-b412bab46a9c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.195628 Jun 15 00:55:34.850841 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 516/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:34 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:35.867854 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:35.868576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:35.874889 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:35.875327 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:35.876125 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:35.876687 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:36.008659 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:36.016647 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-16eef062-c497-4716-a67d-e0e40e30e819 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1264 microversion: 2.1 time: 0.152931 Jun 15 00:55:36.017286 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 554/1070] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:35 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:36.899825 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:55:36.900395 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 00:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:55:37.033828 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:37.034468 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:37.040917 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:37.041361 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:37.042112 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:37.042540 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:37.168043 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:37.176055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a23e1820-b7e6-4953-adfb-0c5d74c54e6f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1451 microversion: 2.1 time: 0.146478 Jun 15 00:55:37.176604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 517/1071] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:37 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:37.191620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:55:37.192292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:55:37.198624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:37.199256 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:37.199791 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:37.200238 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:37.330469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:55:37.337956 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-4a105645-08a8-40ac-a381-212bdb234b10 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1451 microversion: 2.1 time: 0.150154 Jun 15 00:55:37.338508 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 555/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:55:37 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:55:39.449365 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-26a13509-4388-478d-ad54-fbe099cabb23 req-6ec86ac2-e02a-450e-9e5a-8bbfb79a875f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e3a164-15bb-4b51-996d-b66ddf8f354b", "tag": "933a7e51-7923-4837-b690-69464641d2bd"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:55:39.458743 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-26a13509-4388-478d-ad54-fbe099cabb23 req-6ec86ac2-e02a-450e-9e5a-8bbfb79a875f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:55:39.463339 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-26a13509-4388-478d-ad54-fbe099cabb23 req-6ec86ac2-e02a-450e-9e5a-8bbfb79a875f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:55:39.470079 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-26a13509-4388-478d-ad54-fbe099cabb23 req-6ec86ac2-e02a-450e-9e5a-8bbfb79a875f service nova] Creating event network-changed:933a7e51-7923-4837-b690-69464641d2bd for instance 00e3a164-15bb-4b51-996d-b66ddf8f354b on hv-cinder-84517 Jun 15 00:55:39.475236 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-26a13509-4388-478d-ad54-fbe099cabb23 req-6ec86ac2-e02a-450e-9e5a-8bbfb79a875f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029624 Jun 15 00:55:39.476071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 518/1073] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:57:03.480967 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:57:03.522153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 00:57:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:57:05.644409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:57:05.645018 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 00:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:57:36.951502 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:36.952281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=58 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:36.956067 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:36.956549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:36.962443 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:36.962886 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:36.963635 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:36.964097 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:36.990254 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Going to try to terminate instance {{(pid=124683) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 00:57:37.244381 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-748eb75a-13ea-4475-9116-5e682b6d5759 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "DELETE /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 204 len: 0 microversion: 2.1 time: 0.294267 Jun 15 00:57:37.244881 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 556/1074] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 00:57:36 2022] DELETE /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 00:57:37.251066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31f5a483-0d06-4814-9ddb-2638848f5da9] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 15 00:57:37.253213 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=24 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:37.253213 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=52 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:37.258072 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:37.258774 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:37.264764 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:37.265721 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:37.266460 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:37.266892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:37.395146 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:37.402992 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-a933c334-29fa-4841-b43e-9936908aa8dd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1576 microversion: 2.1 time: 0.153827 Jun 15 00:57:37.403543 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 519/1075] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:37 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:38.421337 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:38.422523 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:38.429020 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:38.429463 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:38.430213 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:38.430644 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:38.557379 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:38.565323 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-039994e8-6b13-4624-b1ee-70fce3fd0a5b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1576 microversion: 2.1 time: 0.148258 Jun 15 00:57:38.565994 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 557/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:38 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:39.582600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:39.583201 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:39.591217 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:39.591537 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:39.592336 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:39.592760 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:39.598105 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] [31f5a483-0d06-4814-9ddb-2638848f5da9] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34944. Jun 15 00:57:39.758396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:39.765983 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-93f46833-ba6c-484e-8a60-0db6ddeaedea tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1576 microversion: 2.1 time: 0.187232 Jun 15 00:57:39.766511 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 520/1077] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:39 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:40.083546 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-5f34862f-ff41-48ab-bccc-7e95cf45e898 req-b23c7b05-23d3-4d95-8a5a-e83e9aab1a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e3a164-15bb-4b51-996d-b66ddf8f354b", "name": "network-vif-deleted", "tag": "933a7e51-7923-4837-b690-69464641d2bd"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:57:40.092588 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5f34862f-ff41-48ab-bccc-7e95cf45e898 req-b23c7b05-23d3-4d95-8a5a-e83e9aab1a6f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:40.092973 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-5f34862f-ff41-48ab-bccc-7e95cf45e898 req-b23c7b05-23d3-4d95-8a5a-e83e9aab1a6f service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:40.104547 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-5f34862f-ff41-48ab-bccc-7e95cf45e898 req-b23c7b05-23d3-4d95-8a5a-e83e9aab1a6f service nova] Creating event network-vif-deleted:933a7e51-7923-4837-b690-69464641d2bd for instance 00e3a164-15bb-4b51-996d-b66ddf8f354b on hv-cinder-84517 Jun 15 00:57:40.110407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-5f34862f-ff41-48ab-bccc-7e95cf45e898 req-b23c7b05-23d3-4d95-8a5a-e83e9aab1a6f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030556 Jun 15 00:57:40.111007 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 558/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:57:40.785549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:40.785549 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:40.790471 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:40.790914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:40.791669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:40.792125 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:40.860197 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:40.867813 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-0ea700a0-ef1c-4920-9a7f-a075b8a6d5f0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 200 len: 1223 microversion: 2.1 time: 0.089108 Jun 15 00:57:40.868523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 521/1079] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:40 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:41.885599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:41.886280 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:41.893127 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:41.893564 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:41.894303 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:41.894730 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:41.910620 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] HTTP exception thrown: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Request method failure captured: Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b HTTP/1.1 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqS3aWdHe_ZvZvYUSEK9uNV7bwdM6GZegqKGZv8RnSjeXbHD5ypp8RAWyemd3lATteGq7z1NlacgXufakCXaxksnSG2e31okTdV1W8y1FiJNgSU1LMZUFpr_b_hK-FhTIJefTWY-s17Lsp2L6wjxLqG1z5KGHq71jx6d8FdW-NBogIcA Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 00:57:41.912210 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_108d230bcfcb4f718b59e3bbb875f641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/108d230bcfcb4f718b59e3bbb875f641"}]}] Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-1208039093 Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-1208039093-project Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 272ca1a24cb4415db3abe93e7964b61c Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-1208039093-project Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 00:57:41.913989 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '00e3a164-15bb-4b51-996d-b66ddf8f354b'} Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 00:57:41.915046 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 00:57:41.916769 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 00:57:41.918189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Returning 404 to user: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 00:57:41.918189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f69d5428-4d65-40af-91c2-232ed3701e80 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 404 len: 111 microversion: 2.1 time: 0.032145 Jun 15 00:57:41.918189 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 559/1080] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:41 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 00:57:41.957860 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1425407449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89424052", "security_groups": [{"name": "tempest-secgroup-smoke-1366480916"}], "block_device_mapping_v2": [{"uuid": "a85b28a8-75e6-4809-9f82-24b54335156e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc9677-49b8-4ed8-803a-d2e653f7209d"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:57:42.064780 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] validate_networks() for [('3bdc9677-49b8-4ed8-803a-d2e653f7209d', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:57:42.735718 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:57:42.736185 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:57:42.736646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:57:42.737346 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:57:42.737754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:57:42.746407 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:42.746839 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:42.747646 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:42.748109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:42.764803 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:57:42.768668 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for user 272ca1a24cb4415db3abe93e7964b61c and project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:57:42.825398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:57:42.827527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a85b28a8-75e6-4809-9f82-24b54335156e',volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:57:43.206674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-8bfef749-146e-4eff-88ae-4defe6f98b74 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.252510 Jun 15 00:57:43.207443 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 522/1081] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:57:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:57:43.217212 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-64bb844f-9ff3-46e0-9076-77d96bea07e4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:43.217927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-64bb844f-9ff3-46e0-9076-77d96bea07e4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:43.271400 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-64bb844f-9ff3-46e0-9076-77d96bea07e4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:43.278008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-64bb844f-9ff3-46e0-9076-77d96bea07e4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1093 microversion: 2.1 time: 0.064541 Jun 15 00:57:43.278558 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 560/1082] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:43 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:44.295534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:44.296789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:44.303078 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:44.305421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:44.305421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:44.305421 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:44.363981 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:44.371366 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-14e62234-c704-4dcd-88f2-d16b3a0faadd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1143 microversion: 2.1 time: 0.080144 Jun 15 00:57:44.371933 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 523/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:44 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:45.388109 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:45.388806 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:45.397184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:45.397711 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:45.398539 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:45.399041 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:45.477549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:45.486024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-ce01c02b-1413-414b-b8a8-3d9cc42cf93a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1199 microversion: 2.1 time: 0.101719 Jun 15 00:57:45.486783 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 561/1084] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:45 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:46.502819 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:46.503438 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:46.512015 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:46.512467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:46.513297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:46.513697 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:46.651664 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:46.659195 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-c000c9d0-414a-4a31-a626-c511cf31b125 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1277 microversion: 2.1 time: 0.160687 Jun 15 00:57:46.659989 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 524/1085] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:46 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:46.999838 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-8f50868b-404d-4263-9a73-4f2fa196c001 req-90468ae0-ce74-4d93-9f98-33602e367382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0337b14b-8135-46db-ba99-383bf294ad64", "tag": "5676cbba-46b2-454d-85e3-0de3dc5ab7fa"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:57:47.009258 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-8f50868b-404d-4263-9a73-4f2fa196c001 req-90468ae0-ce74-4d93-9f98-33602e367382 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:47.012936 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-8f50868b-404d-4263-9a73-4f2fa196c001 req-90468ae0-ce74-4d93-9f98-33602e367382 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:47.023096 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-8f50868b-404d-4263-9a73-4f2fa196c001 req-90468ae0-ce74-4d93-9f98-33602e367382 service nova] Creating event network-changed:5676cbba-46b2-454d-85e3-0de3dc5ab7fa for instance 0337b14b-8135-46db-ba99-383bf294ad64 on hv-cinder-84517 Jun 15 00:57:47.028531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-8f50868b-404d-4263-9a73-4f2fa196c001 req-90468ae0-ce74-4d93-9f98-33602e367382 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032906 Jun 15 00:57:47.029347 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 562/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 00:57:47.675402 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:47.676057 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:47.682438 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:47.682879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:47.683620 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:47.684091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:47.882275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:47.890154 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-46063b3e-f7d0-436e-bfcc-3614c6d281a0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.218132 Jun 15 00:57:47.890729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 525/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:47 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:48.908251 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:48.908860 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:48.915511 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:48.915985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:48.916731 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:48.917155 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:49.049804 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:49.053984 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2320938-2af6-4ee8-ad86-b2ef6e7bd7bc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.150441 Jun 15 00:57:49.054538 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 563/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:48 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:50.070435 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:50.071031 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:50.077940 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:50.078377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:50.079122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:50.079546 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:50.209355 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:50.216834 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-32545ac0-5ffb-49dd-ae54-8b4546da335c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.150223 Jun 15 00:57:50.217386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 526/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:50 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:51.234742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:51.235353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:51.241763 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:51.242206 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:51.242954 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:51.243384 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:51.368764 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:51.376024 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-1c1a049a-5371-41d1-8989-39970ad5fb1a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.145665 Jun 15 00:57:51.376576 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 564/1090] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:51 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:52.391776 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:52.392398 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:52.398976 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:52.399413 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:52.400180 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:52.400604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:52.526566 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:52.534426 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-17c465da-e6d9-43f3-a70f-d443bff9e497 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.146488 Jun 15 00:57:52.534984 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 527/1091] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:52 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:53.551349 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:53.551969 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:53.554345 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:53.559130 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:53.559573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:53.560353 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:53.560789 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:53.695727 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:53.704031 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-21c106b1-842f-40e8-bfb6-5dbc24723eb5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.156497 Jun 15 00:57:53.704640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 565/1092] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:53 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:54.722514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:54.723118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:54.725032 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:54.725701 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:54.730919 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:54.731359 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:54.732138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:54.732569 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:54.864590 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:54.872122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-1443c16a-740e-4803-8a31-d792bad1cedc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.154491 Jun 15 00:57:54.872690 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 528/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:54 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:55.889183 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:55.890326 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:55.897061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:55.897505 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:55.898259 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:55.898689 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:56.029050 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:56.037065 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-603b7af7-b1f9-41f2-89bb-c8ba94fbdecc tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.151726 Jun 15 00:57:56.037624 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 566/1094] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:55 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:56.981710 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-d31d4210-209d-4e29-90ef-01cc424d0f6b req-5dadf975-74f8-475b-99d6-cf6b79928ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0337b14b-8135-46db-ba99-383bf294ad64", "name": "network-vif-plugged", "status": "completed", "tag": "5676cbba-46b2-454d-85e3-0de3dc5ab7fa"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:57:56.990090 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d31d4210-209d-4e29-90ef-01cc424d0f6b req-5dadf975-74f8-475b-99d6-cf6b79928ded service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:56.990523 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-d31d4210-209d-4e29-90ef-01cc424d0f6b req-5dadf975-74f8-475b-99d6-cf6b79928ded service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:57.001740 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-d31d4210-209d-4e29-90ef-01cc424d0f6b req-5dadf975-74f8-475b-99d6-cf6b79928ded service nova] Creating event network-vif-plugged:5676cbba-46b2-454d-85e3-0de3dc5ab7fa for instance 0337b14b-8135-46db-ba99-383bf294ad64 on hv-cinder-84517 Jun 15 00:57:57.006685 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-d31d4210-209d-4e29-90ef-01cc424d0f6b req-5dadf975-74f8-475b-99d6-cf6b79928ded service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083843 Jun 15 00:57:57.007255 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 529/1095] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:57:57.053892 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:57.054531 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:57.061151 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:57.061696 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:57.062360 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:57.062790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:57.193995 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:57.201390 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-96433ce9-2a0e-4935-8f21-bf51dff7f45c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.151852 Jun 15 00:57:57.201935 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 567/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:57 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 00:57:58.219091 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:58.219775 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:58.225892 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:58.226330 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:58.227071 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:58.227503 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:58.355519 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:58.363470 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-d973b3e6-7dca-4581-a055-9cff72a55d24 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1265 microversion: 2.1 time: 0.149032 Jun 15 00:57:58.364055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 530/1097] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:58 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:59.380478 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:59.381092 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:59.387441 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:59.387876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:59.388638 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:59.389061 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:59.513078 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:59.521356 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2203a76-ef47-4ce1-b28f-8667bb19b48f tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1451 microversion: 2.1 time: 0.144504 Jun 15 00:57:59.521928 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 568/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:59 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:57:59.537280 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:57:59.537885 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:57:59.544297 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:59.544742 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:59.545492 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:57:59.545918 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:57:59.675470 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:57:59.682521 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-01e160b0-05bb-471d-b555-431922c6e6e8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1451 microversion: 2.1 time: 0.148960 Jun 15 00:57:59.683103 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 531/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:57:59 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:58:01.833506 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-7396b3df-2137-42f0-b270-6f0fe22070ab req-1dce0108-cd22-4736-9c83-f8488da54333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0337b14b-8135-46db-ba99-383bf294ad64", "tag": "5676cbba-46b2-454d-85e3-0de3dc5ab7fa"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:58:01.841742 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7396b3df-2137-42f0-b270-6f0fe22070ab req-1dce0108-cd22-4736-9c83-f8488da54333 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:58:01.842179 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-7396b3df-2137-42f0-b270-6f0fe22070ab req-1dce0108-cd22-4736-9c83-f8488da54333 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:58:01.852877 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-7396b3df-2137-42f0-b270-6f0fe22070ab req-1dce0108-cd22-4736-9c83-f8488da54333 service nova] Creating event network-changed:5676cbba-46b2-454d-85e3-0de3dc5ab7fa for instance 0337b14b-8135-46db-ba99-383bf294ad64 on hv-cinder-84517 Jun 15 00:58:01.857876 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-7396b3df-2137-42f0-b270-6f0fe22070ab req-1dce0108-cd22-4736-9c83-f8488da54333 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027999 Jun 15 00:58:01.858481 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 569/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:58:36.169124 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 00:58:36.169697 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 00:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 00:59:48.787754 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:48.788535 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=70 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:48.792390 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-33889109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-89424052", "security_groups": [{"name": "tempest-secgroup-smoke-1366480916"}], "block_device_mapping_v2": [{"uuid": "aaf0e37a-d4da-4543-bbce-87aaef090d7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bdc9677-49b8-4ed8-803a-d2e653f7209d"}]}} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:59:48.903604 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.network.neutron [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] validate_networks() for [('3bdc9677-49b8-4ed8-803a-d2e653f7209d', None, None, None, None, None)] {{(pid=124682) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 00:59:49.260467 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 00:59:49.260884 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image limits 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 00:59:49.261344 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Flavor pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 00:59:49.261741 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Image pref 0:0:0 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 00:59:49.262138 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.virt.hardware [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 00:59:49.271439 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:49.272148 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:49.272926 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:49.273377 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:49.290621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 00:59:49.294524 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.quota [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Getting quotas for user 272ca1a24cb4415db3abe93e7964b61c and project 108d230bcfcb4f718b59e3bbb875f641. Resources: {'ram', 'cores', 'instances'} {{(pid=124682) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 00:59:49.350122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Going to run 1 instances... {{(pid=124682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 00:59:49.352233 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaf0e37a-d4da-4543-bbce-87aaef090d7d',volume_size=None,volume_type=None)] {{(pid=124682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 00:59:49.719446 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-fb1472d2-2e25-458d-9faf-33db8a97e057 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.933416 Jun 15 00:59:49.720106 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 532/1101] 10.222.0.17 () {60 vars in 1146 bytes} [Wed Jun 15 00:59:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 00:59:49.728247 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR oslo.messaging._drivers.impl_rabbit [-] [08c1af33-a775-4ea6-a189-a5bdc2f9b9b2] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 15 00:59:49.728846 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:49.730163 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:49.734927 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-fbc6cd12-136f-400a-83f5-0b7c7fb1a9ff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:49.735932 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-fbc6cd12-136f-400a-83f5-0b7c7fb1a9ff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:49.801595 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-fbc6cd12-136f-400a-83f5-0b7c7fb1a9ff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:49.806264 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-fbc6cd12-136f-400a-83f5-0b7c7fb1a9ff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1091 microversion: 2.1 time: 0.079892 Jun 15 00:59:49.807942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 570/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:49 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1091 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:50.825386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:50.826500 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:50.833176 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:50.833621 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:50.834369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:50.834801 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:50.892830 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:50.900447 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-5e419c88-ed85-471b-b0d4-9fb5b19ecc96 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1141 microversion: 2.1 time: 0.079459 Jun 15 00:59:50.901046 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 533/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:50 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1141 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:51.918436 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:51.919035 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:51.929107 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:51.933064 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:51.933064 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:51.933064 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:51.936118 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] [08c1af33-a775-4ea6-a189-a5bdc2f9b9b2] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 35126. Jun 15 00:59:51.991144 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:51.998437 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-8e063293-c9f3-44ab-a1f4-be21d2b45aaf tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1133 microversion: 2.1 time: 0.084428 Jun 15 00:59:51.998987 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 571/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:51 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1133 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:53.015647 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:53.019180 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:53.023619 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:53.024089 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:53.024879 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:53.025323 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:53.101941 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:53.110534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e2117871-c857-487b-acf7-9667d134b854 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1207 microversion: 2.1 time: 0.098951 Jun 15 00:59:53.111104 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 534/1105] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:53 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1207 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:54.127590 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:54.128818 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:54.134867 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:54.135312 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:54.136104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:54.136541 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:54.319557 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:54.331676 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7ee802b0-ba4a-41e2-b87b-a03b7c1c8f99 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1275 microversion: 2.1 time: 0.205493 Jun 15 00:59:54.331676 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 572/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:54 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:54.707114 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-5ac555fc-b96b-4a3e-ae28-3a3cc1f05d52 req-9f1a317f-ee26-4e7d-8188-36ed4460608e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a02c3a-e902-4afc-86b7-5b88aa4b64e2", "tag": "5c7603fa-7137-4dc8-a675-5120a2cfd547"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 00:59:54.717253 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5ac555fc-b96b-4a3e-ae28-3a3cc1f05d52 req-9f1a317f-ee26-4e7d-8188-36ed4460608e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:54.717959 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-5ac555fc-b96b-4a3e-ae28-3a3cc1f05d52 req-9f1a317f-ee26-4e7d-8188-36ed4460608e service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:54.729469 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-5ac555fc-b96b-4a3e-ae28-3a3cc1f05d52 req-9f1a317f-ee26-4e7d-8188-36ed4460608e service nova] Creating event network-changed:5c7603fa-7137-4dc8-a675-5120a2cfd547 for instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 on hv-cinder-84517 Jun 15 00:59:54.736127 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-5ac555fc-b96b-4a3e-ae28-3a3cc1f05d52 req-9f1a317f-ee26-4e7d-8188-36ed4460608e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098618 Jun 15 00:59:54.737303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 535/1107] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 00:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 00:59:55.345537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:55.346153 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:55.352726 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:55.353177 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:55.353999 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:55.354438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:55.485288 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:55.492901 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a1615c9f-725e-458a-9ab4-3744165de958 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.151380 Jun 15 00:59:55.493462 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 573/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:55 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:56.556556 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:56.557245 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:56.564982 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:56.565454 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:56.566306 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:56.566840 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:56.704308 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:56.711725 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-09d27af1-362b-4489-994d-9e0a66b9a566 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.205606 Jun 15 00:59:56.712304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 536/1109] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:56 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:57.727751 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:57.728396 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:57.735079 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:57.735527 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:57.736322 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:57.736757 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:57.862599 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:57.869882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-87e22131-3264-484e-9443-bff4b466ef7d tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.146059 Jun 15 00:59:57.870430 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 574/1110] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:57 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 00:59:58.888968 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 00:59:58.889689 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 00:59:58.896292 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:58.896986 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:58.897733 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 00:59:58.898157 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 00:59:59.025878 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 00:59:59.033143 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-38420df0-3695-4222-a837-cab091f8f20b tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.148080 Jun 15 00:59:59.033692 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 537/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 00:59:58 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:00.049826 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:00.053273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:00.053273 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell0:SELECT=2 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:00:00.057654 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:00.058099 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:00.058899 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:00.059325 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:00.187489 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:00.195103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-01a4b37d-be7d-42be-ba61-5866b04dde7a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.149145 Jun 15 01:00:00.195660 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 575/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:00 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:01.212397 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:01.212999 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:01.214909 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=2 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:00:01.215669 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell0:SELECT=6 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:00:01.221352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:01.225914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:01.225914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:01.225914 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:01.352857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:01.360415 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-9038e74b-d84c-446a-9620-5c3c353ce1c4 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.151890 Jun 15 01:00:01.360987 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 538/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:01 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:02.377239 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:02.377833 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:02.384520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:02.384953 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:02.385692 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:02.386113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:02.515724 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:02.523346 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-a2a9a94f-584e-4ac9-ace2-6b47817ddab8 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.150179 Jun 15 01:00:02.528968 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 576/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:02 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:03.540905 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:03.541515 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:03.548475 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:03.548915 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:03.549659 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:03.550087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:03.677870 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:03.685950 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-ce612ac2-53cb-4e43-b195-317dbefcf1d5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.149002 Jun 15 01:00:03.686512 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 539/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:03 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 01:00:04.703049 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:04.709449 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:04.710283 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:04.710719 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:04.711459 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:04.711882 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:04.846103 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:04.854009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-7e688830-f9af-4f66-a77e-a2a346460c32 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.155369 Jun 15 01:00:04.854779 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 577/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:04 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:05.545233 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-164bf636-3750-43a9-96f9-161274fb9c38 req-c81b058b-6430-4b9d-b32a-d200ef138a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a02c3a-e902-4afc-86b7-5b88aa4b64e2", "name": "network-vif-plugged", "status": "completed", "tag": "5c7603fa-7137-4dc8-a675-5120a2cfd547"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:00:05.553409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-164bf636-3750-43a9-96f9-161274fb9c38 req-c81b058b-6430-4b9d-b32a-d200ef138a06 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:05.553833 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-164bf636-3750-43a9-96f9-161274fb9c38 req-c81b058b-6430-4b9d-b32a-d200ef138a06 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:05.565205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-164bf636-3750-43a9-96f9-161274fb9c38 req-c81b058b-6430-4b9d-b32a-d200ef138a06 service nova] Creating event network-vif-plugged:5c7603fa-7137-4dc8-a675-5120a2cfd547 for instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 on hv-cinder-84517 Jun 15 01:00:05.570392 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-164bf636-3750-43a9-96f9-161274fb9c38 req-c81b058b-6430-4b9d-b32a-d200ef138a06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029318 Jun 15 01:00:05.570971 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 540/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 01:00:05.870623 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:05.871196 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:05.877549 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:05.877991 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:05.878758 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:05.879215 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:06.071634 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:06.079632 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-43c1e771-2395-42df-a36f-4d7bb49a4ded tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.212955 Jun 15 01:00:06.080218 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 578/1118] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:05 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 01:00:07.098077 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:07.098770 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:07.104862 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:07.105304 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:07.106055 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:07.107083 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:07.238109 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:07.245449 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-224362b3-7794-4d31-8783-4c0bcfe29c21 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1263 microversion: 2.1 time: 0.152076 Jun 15 01:00:07.246002 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 541/1119] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:07 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:08.262082 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:08.262682 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:08.269018 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:08.269455 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:08.270191 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:08.270613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:08.401114 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:08.409165 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-5bb53310-d93c-4a3c-a70f-fcdebf0922fa tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1450 microversion: 2.1 time: 0.151093 Jun 15 01:00:08.409717 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 579/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:08 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:08.425514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:00:08.426122 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:00:08.432732 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:08.433198 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:08.433949 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:08.434402 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:08.560507 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:00:08.567823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-22794b76-3428-4475-b303-d93c7a135a06 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1450 microversion: 2.1 time: 0.146158 Jun 15 01:00:08.568409 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 542/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:00:08 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1450 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:00:10.437104 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-a437243a-a9a8-4094-8394-06dcca2ba314 req-6ed6870b-1cf4-4cec-85af-beeb98202e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a02c3a-e902-4afc-86b7-5b88aa4b64e2", "tag": "5c7603fa-7137-4dc8-a675-5120a2cfd547"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:00:10.445679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-a437243a-a9a8-4094-8394-06dcca2ba314 req-6ed6870b-1cf4-4cec-85af-beeb98202e31 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:00:10.446113 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-a437243a-a9a8-4094-8394-06dcca2ba314 req-6ed6870b-1cf4-4cec-85af-beeb98202e31 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:00:10.457635 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-a437243a-a9a8-4094-8394-06dcca2ba314 req-6ed6870b-1cf4-4cec-85af-beeb98202e31 service nova] Creating event network-changed:5c7603fa-7137-4dc8-a675-5120a2cfd547 for instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 on hv-cinder-84517 Jun 15 01:00:10.463332 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-a437243a-a9a8-4094-8394-06dcca2ba314 req-6ed6870b-1cf4-4cec-85af-beeb98202e31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029477 Jun 15 01:00:10.463679 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 580/1122] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 01:00:23.489778 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:00:23.490472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 01:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:00:25.652729 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:00:25.653792 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 01:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:01:50.179028 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:01:50.179786 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG dbcounter [-] [124682] Writing DB stats nova_cell1:SELECT=54 {{(pid=124682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:01:50.183226 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_api:SELECT=24 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:01:50.184154 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG dbcounter [-] [124683] Writing DB stats nova_cell1:SELECT=56 {{(pid=124683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:01:50.190916 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:50.191416 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:50.198378 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:50.203584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:50.203584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:50.203584 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:50.227273 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 01:01:50.253765 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-722d7575-a85c-470d-8a18-32891b62bab9 req-df0b226d-670b-482f-8dc4-375450c5ad58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a02c3a-e902-4afc-86b7-5b88aa4b64e2", "tag": "5c7603fa-7137-4dc8-a675-5120a2cfd547"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:01:50.263942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-722d7575-a85c-470d-8a18-32891b62bab9 req-df0b226d-670b-482f-8dc4-375450c5ad58 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:50.264407 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-722d7575-a85c-470d-8a18-32891b62bab9 req-df0b226d-670b-482f-8dc4-375450c5ad58 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:50.275233 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-722d7575-a85c-470d-8a18-32891b62bab9 req-df0b226d-670b-482f-8dc4-375450c5ad58 service nova] Creating event network-changed:5c7603fa-7137-4dc8-a675-5120a2cfd547 for instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 on hv-cinder-84517 Jun 15 01:01:50.280613 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-722d7575-a85c-470d-8a18-32891b62bab9 req-df0b226d-670b-482f-8dc4-375450c5ad58 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103834 Jun 15 01:01:50.283790 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 581/1123] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 01:01:50.499050 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-908f08c5-6b5f-4f74-8694-d3ac835f3bbb tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 204 len: 0 microversion: 2.1 time: 0.324517 Jun 15 01:01:50.503264 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 543/1124] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 01:01:50 2022] DELETE /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 01:01:50.509603 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:50.511184 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:50.518785 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:50.519225 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:50.520316 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:50.520775 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:50.698942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:01:50.706519 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-0f3ed578-c8fd-4635-8334-4496109e7e71 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1575 microversion: 2.1 time: 0.201946 Jun 15 01:01:50.707095 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 582/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:50 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:01:51.725300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:51.725983 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:51.732674 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:51.733119 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:51.733873 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:51.734294 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:51.926266 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:01:51.934205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-df6490cd-f0a4-45c5-b87f-2df2dbf1fb0a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1575 microversion: 2.1 time: 0.213313 Jun 15 01:01:51.934763 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 544/1126] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:51 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:01:52.951553 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:52.952358 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:52.959009 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:52.959472 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:52.960243 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:52.960669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:52.992329 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-aa61d9ed-58b8-4dcf-9d28-675bf2869d4b req-f85f1bf2-7c27-4e88-9316-2686166a2e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a02c3a-e902-4afc-86b7-5b88aa4b64e2", "name": "network-vif-deleted", "tag": "5c7603fa-7137-4dc8-a675-5120a2cfd547"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:01:53.001767 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-aa61d9ed-58b8-4dcf-9d28-675bf2869d4b req-f85f1bf2-7c27-4e88-9316-2686166a2e7b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:53.008534 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-aa61d9ed-58b8-4dcf-9d28-675bf2869d4b req-f85f1bf2-7c27-4e88-9316-2686166a2e7b service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:53.013627 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-aa61d9ed-58b8-4dcf-9d28-675bf2869d4b req-f85f1bf2-7c27-4e88-9316-2686166a2e7b service nova] Creating event network-vif-deleted:5c7603fa-7137-4dc8-a675-5120a2cfd547 for instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 on hv-cinder-84517 Jun 15 01:01:53.018600 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-aa61d9ed-58b8-4dcf-9d28-675bf2869d4b req-f85f1bf2-7c27-4e88-9316-2686166a2e7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029963 Jun 15 01:01:53.019177 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 545/1127] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 01:01:53.028110 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:01:53.035749 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-32303f0b-c8c3-4938-998f-51d4cdec3c6e tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1388 microversion: 2.1 time: 0.088671 Jun 15 01:01:53.037672 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 583/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:52 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:01:54.053542 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:54.054226 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:54.060342 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:54.060784 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:54.061527 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:54.061958 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:54.090956 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:54.091389 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:54.091821 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.objects.instance [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lazy-loading 'fault' on Instance uuid 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 {{(pid=124682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 01:01:54.134352 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:01:54.141671 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-3651693c-0474-4230-ba09-d84b1501259a tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 200 len: 1227 microversion: 2.1 time: 0.092782 Jun 15 01:01:54.142221 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 546/1129] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:54 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 1227 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:01:55.158573 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:55.159181 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 08a02c3a-e902-4afc-86b7-5b88aa4b64e2] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:55.165592 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:55.166544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:55.167290 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:55.167718 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:55.180852 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] HTTP exception thrown: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Request method failure captured: Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 HTTP/1.1 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqS3aWdHe_ZvZvYUSEK9uNV7bwdM6GZegqKGZv8RnSjeXbHD5ypp8RAWyemd3lATteGq7z1NlacgXufakCXaxksnSG2e31okTdV1W8y1FiJNgSU1LMZUFpr_b_hK-FhTIJefTWY-s17Lsp2L6wjxLqG1z5KGHq71jx6d8FdW-NBogIcA Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 01:01:55.183116 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_108d230bcfcb4f718b59e3bbb875f641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/108d230bcfcb4f718b59e3bbb875f641"}]}] Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 272ca1a24cb4415db3abe93e7964b61c Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. Jun 15 01:01:55.184957 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '08a02c3a-e902-4afc-86b7-5b88aa4b64e2'} Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 01:01:55.185964 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. Jun 15 01:01:55.187640 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:01:55.189293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Returning 404 to user: Instance 08a02c3a-e902-4afc-86b7-5b88aa4b64e2 could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 01:01:55.189293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-bca5f03e-c5a7-4325-90f9-3d1ae44374fd tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2" status: 404 len: 111 microversion: 2.1 time: 0.029810 Jun 15 01:01:55.189293 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 584/1130] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:55 2022] GET /compute/v2.1/servers/08a02c3a-e902-4afc-86b7-5b88aa4b64e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 01:01:56.177572 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:01:56.178159 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 01:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:01:58.558014 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:58.558525 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:58.566544 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [req-2a30ae32-aceb-40eb-ad7c-4d4100f9b97d req-aac6feac-5f42-4d89-9838-41d2a7c66db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0337b14b-8135-46db-ba99-383bf294ad64", "tag": "5676cbba-46b2-454d-85e3-0de3dc5ab7fa"}]} {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:01:58.575410 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:58.575857 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:58.576037 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2a30ae32-aceb-40eb-ad7c-4d4100f9b97d req-aac6feac-5f42-4d89-9838-41d2a7c66db8 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:58.576438 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [req-2a30ae32-aceb-40eb-ad7c-4d4100f9b97d req-aac6feac-5f42-4d89-9838-41d2a7c66db8 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:58.576642 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:58.577066 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:58.589530 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.compute.server_external_events [req-2a30ae32-aceb-40eb-ad7c-4d4100f9b97d req-aac6feac-5f42-4d89-9838-41d2a7c66db8 service nova] Creating event network-changed:5676cbba-46b2-454d-85e3-0de3dc5ab7fa for instance 0337b14b-8135-46db-ba99-383bf294ad64 on hv-cinder-84517 Jun 15 01:01:58.595053 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [req-2a30ae32-aceb-40eb-ad7c-4d4100f9b97d req-aac6feac-5f42-4d89-9838-41d2a7c66db8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032109 Jun 15 01:01:58.595827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 585/1131] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 01:01:58.603279 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Going to try to terminate instance {{(pid=124682) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 01:01:58.920078 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-e0e6f6cf-7489-45af-b620-ef9c53258ca6 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 204 len: 0 microversion: 2.1 time: 0.366270 Jun 15 01:01:58.920894 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 547/1132] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 01:01:58 2022] DELETE /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 01:01:58.929422 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:01:58.930105 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:01:58.936840 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:58.939524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:58.939524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:01:58.939524 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:01:59.073299 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:01:59.080815 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-d1cf5191-2ec6-43b3-a88b-a8f79577deff tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1575 microversion: 2.1 time: 0.155645 Jun 15 01:01:59.081375 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 586/1133] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:01:58 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:02:00.099205 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:00.099925 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:00.106888 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:00.107328 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:00.108118 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:00.108550 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:00.237404 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.policy [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124682) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:02:00.244947 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-2eff0199-7798-467a-9c4d-1a790d2e03b1 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1575 microversion: 2.1 time: 0.149978 Jun 15 01:02:00.245496 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 548/1134] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:02:00 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:02:01.261567 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:01.262204 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:01.268827 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:01.269281 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:01.270038 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:01.270469 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:01.355386 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [req-bc5f3047-de42-4293-a272-ae72fef0423f req-325b1fc3-6408-46a4-bef2-024008b6c256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0337b14b-8135-46db-ba99-383bf294ad64", "name": "network-vif-deleted", "tag": "5676cbba-46b2-454d-85e3-0de3dc5ab7fa"}]} {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 01:02:01.355942 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:02:01.363350 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-f229a61b-50dd-4c5a-ba2a-cebc9cd5a1c5 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1389 microversion: 2.1 time: 0.105728 Jun 15 01:02:01.363823 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bc5f3047-de42-4293-a272-ae72fef0423f req-325b1fc3-6408-46a4-bef2-024008b6c256 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:01.363985 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 587/1135] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:02:01 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1389 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 01:02:01.364303 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [req-bc5f3047-de42-4293-a272-ae72fef0423f req-325b1fc3-6408-46a4-bef2-024008b6c256 service nova] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:01.375789 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.compute.server_external_events [req-bc5f3047-de42-4293-a272-ae72fef0423f req-325b1fc3-6408-46a4-bef2-024008b6c256 service nova] Creating event network-vif-deleted:5676cbba-46b2-454d-85e3-0de3dc5ab7fa for instance 0337b14b-8135-46db-ba99-383bf294ad64 on hv-cinder-84517 Jun 15 01:02:01.380561 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [req-bc5f3047-de42-4293-a272-ae72fef0423f req-325b1fc3-6408-46a4-bef2-024008b6c256 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029335 Jun 15 01:02:01.381129 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 549/1136] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Jun 15 01:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 01:02:02.380919 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:02.381520 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:02.387857 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:02.388324 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:02.389066 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:02.389496 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:02.420767 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:02.421207 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:02.421643 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.objects.instance [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lazy-loading 'fault' on Instance uuid 0337b14b-8135-46db-ba99-383bf294ad64 {{(pid=124683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 01:02:02.461845 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.policy [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272ca1a24cb4415db3abe93e7964b61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '108d230bcfcb4f718b59e3bbb875f641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124683) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 01:02:02.468669 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-e6c656e0-e1b9-4dd4-a793-a833b332169c tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 200 len: 1229 microversion: 2.1 time: 0.091609 Jun 15 01:02:02.469221 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 588/1137] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:02:02 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 01:02:03.487107 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:03.586396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 0337b14b-8135-46db-ba99-383bf294ad64] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:03.586396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:03.586396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:03.586396 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] HTTP exception thrown: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Request method failure captured: Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 HTTP/1.1 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqS3aWdHe_ZvZvYUSEK9uNV7bwdM6GZegqKGZv8RnSjeXbHD5ypp8RAWyemd3lATteGq7z1NlacgXufakCXaxksnSG2e31okTdV1W8y1FiJNgSU1LMZUFpr_b_hK-FhTIJefTWY-s17Lsp2L6wjxLqG1z5KGHq71jx6d8FdW-NBogIcA Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 01:02:03.587369 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_108d230bcfcb4f718b59e3bbb875f641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/108d230bcfcb4f718b59e3bbb875f641"}]}] Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 272ca1a24cb4415db3abe93e7964b61c Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. Jun 15 01:02:03.589371 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '0337b14b-8135-46db-ba99-383bf294ad64'} Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 01:02:03.590379 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. Jun 15 01:02:03.594275 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:03.595809 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Returning 404 to user: Instance 0337b14b-8135-46db-ba99-383bf294ad64 could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 01:02:03.595809 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-cf9afc49-ea2c-4cb5-864b-db0bc08bb5c0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64" status: 404 len: 111 microversion: 2.1 time: 0.032691 Jun 15 01:02:03.595809 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 550/1138] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:02:03 2022] GET /compute/v2.1/servers/0337b14b-8135-46db-ba99-383bf294ad64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 01:02:04.251661 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:04.252197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.compute.api [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124683) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:04.258537 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:04.258992 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:04.260292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:04.260721 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG oslo_concurrency.lockutils [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:04.273914 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.wsgi [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] HTTP exception thrown: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Request method failure captured: Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: request: DELETE /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b HTTP/1.1 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept: application/json Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Accept-Encoding: identity Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Connection: close Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Length: 0 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Content-Type: application/json Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Host: 10.222.0.17 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Openstack-System-Scope: None Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: User-Agent: python-urllib3/1.26.9 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Auth-Token: gAAAAABiqS3aWdHe_ZvZvYUSEK9uNV7bwdM6GZegqKGZv8RnSjeXbHD5ypp8RAWyemd3lATteGq7z1NlacgXufakCXaxksnSG2e31okTdV1W8y1FiJNgSU1LMZUFpr_b_hK-FhTIJefTWY-s17Lsp2L6wjxLqG1z5KGHq71jx6d8FdW-NBogIcA Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Id: None Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Domain-Name: None Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Identity-Status: Confirmed Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Is-Admin-Project: True Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Id: default Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Domain-Name: Default Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Project-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Role: member,reader Jun 15 01:02:04.276197 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Roles: member,reader Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_108d230bcfcb4f718b59e3bbb875f641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/108d230bcfcb4f718b59e3bbb875f641"}]}] Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Id: default Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Domain-Name: Default Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Id: 272ca1a24cb4415db3abe93e7964b61c Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: X-User-Name: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: method: > Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: exception: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.278071 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: action_args: {'id': '00e3a164-15bb-4b51-996d-b66ddf8f354b'} Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 01:02:04.279008 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.280372 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.281714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Returning 404 to user: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. {{(pid=124683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 01:02:04.281714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-c70cc9da-0ea5-4204-82d4-45343ca73b22 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "DELETE /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 404 len: 111 microversion: 2.1 time: 0.029812 Jun 15 01:02:04.281714 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 589/1139] 10.222.0.17 () {58 vars in 1238 bytes} [Wed Jun 15 01:02:04 2022] DELETE /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 01:02:04.286248 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '>' {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:04.286883 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.compute.api [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] [instance: 00e3a164-15bb-4b51-996d-b66ddf8f354b] Fetching instance by UUID {{(pid=124682) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 01:02:04.292869 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:04.293313 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:04.294087 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 01:02:04.294514 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG oslo_concurrency.lockutils [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Lock "db6dffbe-391d-463b-94f8-73114df29399" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 01:02:04.307505 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.wsgi [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] HTTP exception thrown: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Request method failure captured: Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: request: GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b HTTP/1.1 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept: application/json Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Accept-Encoding: identity Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Connection: close Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Length: 0 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Content-Type: application/json Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Host: 10.222.0.17 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Openstack-System-Scope: None Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: User-Agent: python-urllib3/1.26.9 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Auth-Token: gAAAAABiqS3aWdHe_ZvZvYUSEK9uNV7bwdM6GZegqKGZv8RnSjeXbHD5ypp8RAWyemd3lATteGq7z1NlacgXufakCXaxksnSG2e31okTdV1W8y1FiJNgSU1LMZUFpr_b_hK-FhTIJefTWY-s17Lsp2L6wjxLqG1z5KGHq71jx6d8FdW-NBogIcA Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Id: None Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Domain-Name: None Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Identity-Status: Confirmed Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Is-Admin-Project: True Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Id: default Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Domain-Name: Default Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Project-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Role: member,reader Jun 15 01:02:04.309024 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Roles: member,reader Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_108d230bcfcb4f718b59e3bbb875f641", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/108d230bcfcb4f718b59e3bbb875f641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/108d230bcfcb4f718b59e3bbb875f641"}]}] Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Id: 108d230bcfcb4f718b59e3bbb875f641 Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208039093 Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Id: default Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Domain-Name: Default Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Id: 272ca1a24cb4415db3abe93e7964b61c Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: X-User-Name: tempest-TestVolumeBootPattern-1208039093-project Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: method: > Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: exception: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.310709 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: action_args: {'id': '00e3a164-15bb-4b51-996d-b66ddf8f354b'} Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: {{(pid=124682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 01:02:04.311695 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. Jun 15 01:02:04.317603 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: ERROR nova.api.openstack.wsgi Jun 15 01:02:04.319326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: DEBUG nova.api.openstack.wsgi [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Returning 404 to user: Instance 00e3a164-15bb-4b51-996d-b66ddf8f354b could not be found. {{(pid=124682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 01:02:04.319326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO nova.api.openstack.requestlog [None req-23fb6aee-29ec-449d-a1e1-2aea8483d086 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b" status: 404 len: 111 microversion: 2.1 time: 0.027971 Jun 15 01:02:04.319326 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: [pid: 124682|app: 0|req: 551/1140] 10.222.0.17 () {58 vars in 1235 bytes} [Wed Jun 15 01:02:04 2022] GET /compute/v2.1/servers/00e3a164-15bb-4b51-996d-b66ddf8f354b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 01:02:05.834232 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: DEBUG nova.api.openstack.wsgi [None req-801b853e-0855-4e78-b946-6ee1b426e2e0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] Calling method '.version_select at 0x7fa824187af0>' {{(pid=124683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 01:02:05.920292 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO nova.api.openstack.requestlog [None req-801b853e-0855-4e78-b946-6ee1b426e2e0 tempest-TestVolumeBootPattern-1208039093 tempest-TestVolumeBootPattern-1208039093-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89424052" status: 202 len: 0 microversion: 2.1 time: 0.089937 Jun 15 01:02:05.920875 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: [pid: 124683|app: 0|req: 590/1141] 10.222.0.17 () {58 vars in 1256 bytes} [Wed Jun 15 01:02:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-89424052 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 01:03:45.661568 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:03:45.662219 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 01:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:05:16.187211 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:05:16.187713 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 01:05:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:05:23.500168 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:05:23.500820 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 01:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:05:36.915441 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:05:36.916068 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 01:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:07:05.670086 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:07:05.670905 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 01:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:07:17.323300 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:07:17.324029 dv-cinder-845178-5-iscsi devstack@n-api.service[124682]: Wed Jun 15 01:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 01:07:21.172914 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 01:07:21.173453 dv-cinder-845178-5-iscsi devstack@n-api.service[124683]: Wed Jun 15 01:07:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!